If you need to move a large volume of data, you can do so using a Globus endpoint. DME uses Globus for high performance transfer of large files. Endpoints represent locations on a file transfer service server, such as Biowulf or gridftp. In DME CLU or GUI, you can choose to use Globus for file transfer.
For a video of these instructions, refer to Video of Preparing to Use Globus.
To prepare a Globus endpoint:
If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one.
- Log into Globus at the following site:
http://www.globus.org
Use your NIH user account credentials as described in the following page:
https://docs.globus.org/how-to/get-started/ If you do not already have a guest collection in Globus, create one:
- Share your Globus endpoint:
In the Globus File Manager, navigate to the list of endpoints by opening the side bar, clicking Endpoints, and then clicking Shareable by You.
Select the endpoint you want to use. Access the sharing configuration for that endpoint by clicking Permissions.
Add permissions by clicking Add Permissions - Share With. In the Share With field, select the option to share with a group. Click Select a Group.
Search all groups for "HPCDME-" and select the appropriate Globus group for the DME tier you intend to use:
Production: HPCDME-PROD-App-Accts-Pool-FNLCR
- UAT: HPCDME-DEV-App-Accts-Pool-FNLCR
- Select the appropriate permission for the selected group: If you intend to download data from DME to the Globus endpoint, select the write permission.
- Click Add Permission. The system adds the HPCDME Globus group to the list for the current share.
Now you can register or download data in the GUI as described in the following pages:
- Registering from a Globus Endpoint via the GUI
- Downloading to Your File System via the GUI
- Downloading to a Globus Endpoint via the GUI
- Downloading to an AWS S3 Bucket via the GUI
- Downloading to Google Drive via the GUI
To register or download data via CLU, refer to the additional prerequisites described in Getting Started with DME CLU.