Globus is a cloud-based service designed to let users move, share, and discover research data via a single interface, regardless of its location or number of files or size.
Globus was developed and is maintained at the University of Chicago and is used extensively at supercomputer centers and major research facilities.
Globus is available as a free service that any user can access. More on how Globus works can be found on the Globus "How It Works" page.
Further Reading
Globus is a reliable, high-performance file transfer platform allowing users to transfer large amounts of data seamlessly between systems. It aims to make transfers a "click-and-forget" process by setting up configuration details in the background and automating fault recovery.
Globus can be used for both file transfers between OSC and:
Users transferring between OSC and another computing institution with Globus installed do not need to install Globus Connect Personal, and can skip this page.
To use Globus to transfer from a personal computer, you will need to install the Globus Connect Personal client on your computer following the steps below. Those transferring between OSC and another computing institution can skip to Usage.
Watch How to Install Globus Personal
tar -zxvf
globusconnect
, found within the unzipped directoryBy default, Globus will only add certain default folders to the list of files and directories accessible by Globus. To change/add/remove files and directories from this list:
Windows
Mac
Linux
~/.globusonline/lta/config-paths
file. This file is a plain text file, with each line corresponding to the configuration of a particular directory path you wish to make accessible. Each line consists of 3 comma-separated fields as below
<path1>,<sharing flag>,<R/W flag> <path2>,<sharing flag>,<R/W flag> <path3>,<sharing flag>,<R/W flag> ...
Path: an absolute directory/path to be permitted. A leading tilde "~" can be used to represent the home directory of the user that runs globusconnectpersonal.
Sharing Flag: it controls sharing, with a value of "1" allowing sharing for the path and a value of "0" disallowing sharing for the path.
R/W Flag: it determines whether the path will be accessible read-only or read/write, with a "1" permitting read/write access and a "0" marking the path as read-only.
~/.globusonline/lta/config-paths
file, you must stop and restart Globus Connect Personal before the changes will take effect as below$ ./globusconnectpersonal -stop $ ./globusconnectpersonal -start &
Globus is a reliable, high-performance file transfer platform allowing users to transfer large amounts of data seamlessly between systems. It aims to make transfers a "click-and-forget" process by setting up configuration details in the background and automating fault recovery.
Globus can be used for both file transfers between OSC and:
Users transferring between OSC and another computing institution with Globus installed do not need to install Globus Connect Personal.
sftp.osc.edu
. Our general recommendation is that for small files - measured in MB to several hundred MB - to use OnDemand or SFTP. You can continue to use SFTP and get reasonable performance up to file sizes of several GB. For transfers of several GB or larger, you should consider using Globus.We provide instructions on how to transfer data on this page. If you would like to share your data with your collaborators, please see this page.
Watch How to Transfer Files Using Globus
this page. Select 'Ohio Supercomputer Center (OSC)' as the identity provider. You will be redirected to the page below. Provide your OSC HPC credentials:
Endpoint | |
---|---|
OSC's home directory | OSC $HOME |
OSC's project directory | OSC /fs/project |
OSC's scratch directory | OSC /fs/scratch |
OSC's ess storage | OSC /fs/ess |
AWS S3 storage | OSC S3 |
Globus Connect Server allows OSC users to share data with their collaborators who do not have OSC HPC account (the collaborator needs to sign up for a free Globus account though). The advantage of data sharing via Globus is that you do not have to move your data in order to share it. You can select directory paths to be securely shared with your collaborator, and grant them read-only or read-write access.
Watch How to Share Files Using Globus
Endpoint | |
---|---|
OSC's home directory | OSC $HOME |
OSC's project directory | OSC /fs/project |
OSC's scratch directory | OSC /fs/scratch |
OSC's ess storage | OSC /fs/ess |
AWS S3 storage | OSC S3 |
Globus Connect Server v5 allows OSC clients to connect to Amazon S3. Please follow the steps below:
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllBuckets",
"Effect": "Allow",
"Action": [
"s3:ListAllMyBuckets",
"s3:GetBucketLocation"
],
"Resource": "*"
},
{
"Sid": "Bucket",
"Effect": "Allow",
"Action": [
"s3:ListBucket"
],
"Resource": "arn:aws:s3:::osc-globus-test"
},
{
"Sid": "Objects",
"Effect": "Allow",
"Action": [
"s3:DeleteObject",
"s3:GetObject",
"s3:PutObject"
],
"Resource": "arn:aws:s3:::osc-globus-test/*"
}
]
}
Adding InCommon authentication to your Globus account allows you to login to Globus Online using your university credentials. Using this process you can store your Globus username password for safe keeping, and instead use your university username and password to login. If your already logged in to your university authentication system, logging in to Globus can be as simple as two clicks away.
To use this feature, your university needs to be a InCommon participant. Some Ohio universities active in InCommon include: Ohio State University, Case Western University, Columbus State Community College, Miami University, Ohio Northern University, Ohio University, University of Findlay, University of Dayton, and many more.
For a complete list, visit https://incommon.org/participants/ .
When you go to login next, click "alternative login" and then "InCommon / CILogon". Select your university on the next page, and login using your university credentials. Globus will remember this preference, and automatically prompt you to login using your university authentication next time.
OSC clients who are affiliated with Ohio State can deploy their own endpoint on a server using OSU subscriptions. Please follow the steps below: