NIH | National Cancer Institute | NCI Wiki  

If you need to move a large volume of data, you can do so using a Globus endpoint. DME uses Globus for high performance transfer of large files. Endpoints represent locations on a file transfer service server, such as Biowulf or gridftp. In DME CLU or GUI, you can choose to use Globus for file transfer. A prerequisite is a guest collection.

For narrated slides demonstrating these instructions, refer to prep-Globus-slides.pptx.

To prepare a Globus endpoint:

  1. If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one. 

  2. Log into Globus at the following site:
    http://www.globus.org Exit Disclaimer logo
    Use your NIH user account credentials as described in the following page:
    https://docs.globus.org/how-to/get-started/ Exit Disclaimer logo
  3. If you do not already have a guest collection in Globus, create one:

    1. In the Globus File Manager, search for NIH HPC Data Transfer (Biowulf). This is a public endpoint. 
      Results of searching for NIH HPC Data Transfer in Globus.
    2. In the search results, in the row for NIH HPC Data Transfer (Biowulf), click the collection details icon (The collection details icon in Globus.). The details page appears. On the Collections tab, click Add Guest Collection
      Collections tab on the NIH HPC Data Transfer page in Globus.
    3. On the Create new guest collection page, browse to or specify the path to the directory where you want to save your data. Click Create Guest Collection
      The Create new GCSV4 Share page in Globus.
  4. Share your Globus endpoint:
    1. In the Globus File Manager, navigate to the list of collections by opening the side bar, clicking Collections, and then clicking Shareable by You

      List of collections that are shareable by you in Globus.
    2. Select your guest collection. Access the sharing configuration for that collection by clicking Permissions

      Permissions tab for a particular collection in Globus.
    3. Add permissions by clicking Add Permissions - Share With. In the Share With field, select the option to share with a group. Click Select a Group.

      Add Permissions - Share With page in Globus.
    4. Search all groups for "HPCDME-" and select the HPCDME-PROD-App-Accts-Pool-FNLCR group. 

      If you intend to use the UAT tier of DME, select the HPCDME-DEV-App-Accts-Pool-FNLCR group. 

      Search for a Group page in Globus.

    5. Select the appropriate permission for the selected group: If you intend to download data from DME to the Globus endpoint, select the write permission. 

      Add Permissions - Share With page, with group and permissions selected.

    6. Click Add Permission. The system adds the HPCDME Globus group to the list for the current share.  

Now you can register or download data in the GUI as described in the following pages:

To register or download data via CLU, refer to the additional prerequisites described in Getting Started with DME CLU