DME uses Globus for high performance transfer of large files. You can move data from DME to a Globus endpoint, or from a Globus endpoint to DME. Endpoints are destinations that represent locations on a file transfer service server, such as gridftp. The following activities in DME require a Globus endpoint:
- Registering multiple files, or files of more than 100 MB
- Downloading a collection of data files
- Downloading a single file asynchronously
To prepare a Globus endpoint:
- If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one.
- Log into Globus at the following site:
http://www.globus.orgCopy this one into an NCI wiki (not Collaborate) page:The following is the multiexcerpt that may be the source of existing exit disclaimers. Do not copy this one because it places the image on the next line after the link.
- If prompted for login credentials, specify your NCI user account. The Transfer Files page appears. Select Manage Data > Endpoints.
- Begin the process of sharing your shareable Globus endpoint as described in the following page:
https://docs.globus.org/how-to/share-filesCopy this one into an NCI wiki (not Collaborate) page:The following is the multiexcerpt that may be the source of existing exit disclaimers. Do not copy this one because it places the image on the next line after the link.
- On the Sharing tab, in the Share With field, select group. Click Select a Group. The Search for a Group dialog box appears.
Type "HPCDME-" and select the appropriate Globus group for your DOC, as indicated in the following table:
DOC UAT Group Production Group FNLCR HPCDME-PROD-App-Accts-Pool-FNLCR (TBD) HiTIF HPCDME-PROD-App-Accts-Pool-HITIF (TBD) CCBR HPCDME-PROD-App-Accts-Pool-CCBR (TBD) CCR_SBL HPCDME-PROD-App-Accts-Pool-CCR_SBL (TBD) All Others HPCDME-PROD-App-Accts-Pool-Default (TBD) - On the Sharing tab, select the appropriate permission for the selected group:
- If you intend to download data from DME to the Globus endpoint, select the write permission.
- If you intend to only upload data from the Globus endpoint to DME, select the read permission.
- If you intend to download data from DME to the Globus endpoint, select the write permission.
- Click Add Permission. The system adds the HPCDME Globus group to the list for the current share.
- Each time you need to download data from DME, perform the following steps to copy the shared endpoint UUID:
- On the Manage Endpoints page, click Endpoint List. Click shareable by me. An endpoint list appears. The shared endpoint you have just created is available in that list with the following description:
Shared Endpoint on <name of shareable Globus endpoint> - Click the shared endpoint link. A page appears with details about that endpoint.
- Next to the UUID field, click copy.
- On the Manage Endpoints page, click Endpoint List. Click shareable by me. An endpoint list appears. The shared endpoint you have just created is available in that list with the following description:
Now you can upload or download data as described in the following pages: