Page History

If you need to move a large volume of data, you can do so using a Globus endpoint. The system uses Globus for high performance transfer of large files. Endpoints represent locations on a file transfer service server, such as gridftp. A prerequisite is a guest collection.

To prepare a Globus endpoint:

1. If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one.
2. Log into Globus at the following site:
   http://www.globus.org

   Multiexcerpt include
   MultiExcerptName ExitDisclaimer nopanel true PageWithExcerpt wikicontent:Exit Disclaimer to Include

   
   Use your NIH user account credentials as described in the following page:
   https://docs.globus.org/how-to/get-started/

   Multiexcerpt include
   MultiExcerptName ExitDisclaimer nopanel true PageWithExcerpt wikicontent:Exit Disclaimer to Include

3. If you do not already have a guest collection in Globus, create one:

   Panel
   borderColor black borderStyle solid
   Expand title Instructions to Create a Guest Collection In the Globus File Manager, search for NIH HPC Data Transfer (Biowulf). This is a public endpoint.  Image Added In the search results, in the row for NIH HPC Data Transfer (Biowulf), click the collection details icon (Image Added). The details page appears. On the Collections tab, click Add Guest Collection.  Image Added On the Create new Guest Collection page, browse to or specify the path to the directory where you want to save your data. Click Create Guest Collection.  Image Added

4. Share your Globus endpoint:

   1. In the Globus File Manager, navigate to the list of

      endpoints

      collections by opening the side bar, clicking

      Endpoints

      Collections, and then clicking Shareable by You.

       Select the endpoint you want to use

       

      Image Added

   2. Select your guest collection. Access the sharing configuration for that

      endpoint

      collection by clicking

      Sharing

      Permissions. 

      Image Added

   3. Add permissions by clicking Add Permissions - Share With. In the Share With field, select the option to share with a group. Click Select a Group.

      Image Added

   4. Search all groups for "HPCDME-MODAC" and select the appropriate Globus group for the DME tier you intend to use: 

      Production: HPCDME

      MODAC-PROD-App-Accts-Pool-

      FNLCRUAT: HPCDME-DEV-App-Accts-Pool-FNLCR 

      NCI_DOE.

      Image Added

   5. Select the appropriate permission for the selected group: If you intend to download data from DME to the Globus endpoint, select the write permission. 

      If you intend to only upload data from the Globus endpoint to DME, select the read permission. 

      Image Added

   6. Click Add Permission. The system adds the HPCDME the MODAC-PROD-App-Accts-Pool-NCI_DOE Globus group to the list for the current share.  

Now you can upload or download data as described in the following pages:

• Downloading to a Globus Endpoint
• Uploading from a Globus Endpoint into One Asset
• Uploading Multiple Assets from a Globus Endpoint(upload link TBD)