If you need to move a large volume of data, you can do so using a Globus endpoint. DME uses Globus for high performance transfer of large files. Endpoints represent locations on a file transfer service server, such as gridftp. In DME CLU or GUI, you can choose to use Globus for file transfer.
To prepare a Globus endpoint:
- If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one.
- Log into Globus at the following site:
http://www.globus.org
Use your NIH user account credentials as described in the following page:
https://docs.globus.org/how-to/get-started/ - Share your Globus endpoint:
In Globus, navigate to the list of endpoints by opening the side bar, clicking Endpoints, and then clicking Shareable by You.
Select the endpoint you want to use. Access the sharing configuration for that endpoint by clicking Permissions.
Add permissions by clicking Add Permissions - Share With. In the Share With field, select the option to share with a group. Click Select a Group.
Search all groups for "HPCDME-" and select the appropriate Globus group for the DME tier you intend to use:
Production: HPCDME-PROD-App-Accts-Pool-FNLCR
- UAT: HPCDME-DEV-App-Accts-Pool-FNLCR
- Select the appropriate permission for the selected group:
- If you intend to download data from DME to the Globus endpoint, select the write permission.
- If you intend to only upload data from the Globus endpoint to DME, select the read permission.
- Click Add Permission. The system adds the HPCDME Globus group to the list for the current share.
Now you can upload or download data in the GUI as described in the following pages:
- Uploading Data in Bulk via the GUI
- Downloading a Single Data File via the GUI
- Downloading a Collection via the GUI
- Downloading Multiple Data Files via the GUI
- Downloading Multiple Collections via the GUI
To upload or download data via CLU, refer to the additional prerequisites described in Getting Started with DME CLU.
