NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 63 Next »

If you need to move a large volume of data, you can do so using a Globus endpoint. DME uses Globus for high performance transfer of large files. Endpoints are destinations that represent locations on a file transfer service server, such as gridftp. In DME CLU, you can choose to use Globus for file transfer. In DME GUI, the following activities require a Globus endpoint:

  • Registering multiple files
  • Downloading a collection of data files
  • Downloading multiple collections
  • Downloading a single file asynchronously
  • Downloading multiple files

To prepare a Globus endpoint:

  1. If you do not already have a shareable Globus endpoint, contact NCIDataVault@mail.nih.gov and request one.
  2. Log into Globus at the following site:
    http://www.globus.org Exit Disclaimer logo
    Use your NIH user account credentials as described in the following page:
    https://docs.globus.org/how-to/get-started/ Exit Disclaimer logo
  3. Share your Globus endpoint:
    1. In Globus, navigate to the list of endpoints by opening the side bar, clicking Endpoints, and then clicking Shareable by You. Select the endpoint you want to use. Access the sharing configuration for that endpoint by clicking Sharing. 
    2. Add permissions by clicking Add Permissions. In the Share With field, select the option to share with a group. Click Select a Group.

    3. Search all groups for "HPCDME-" and select the appropriate Globus group for your DOC, as indicated in the following table: 

      DOCGroup for the Production Tier of DMEGroup for the UAT Tier of DME
      FNLCRHPCDME-PROD-App-Accts-Pool-FNLCRHPCDME-DEV-App-Accts-Pool-FNLCR
      HiTIFHPCDME-PROD-App-Accts-Pool-HITIFHPCDME-DEV-App-Accts-Pool-HITIF
      CCBRHPCDME-PROD-App-Accts-Pool-CCBRHPCDME-DEV-App-Accts-Pool-CCBR
      CCR_SBLHPCDME-PROD-App-Accts-Pool-CCR_SBLHPCDME-DEV-App-Accts-Pool-CCR_SBL
      All OthersHPCDME-PROD-App-Accts-Pool-DefaultHPCDME-DEV-App-Accts-Pool-Default
    4. Select the appropriate permission for the selected group:
      • If you intend to download data from DME to the Globus endpoint, select the write permission. 
      • If you intend to only upload data from the Globus endpoint to DME, select the read permission. 
    5. Click Add Permission. The system adds the HPCDME Globus group to the list for the current share.  

Each time you need to download data from DME, copy the shared endpoint UUID, as described in Copying the Globus Shared Endpoint UUID. 

Now you can upload or download data in the GUI as described in the following pages:

To upload or download data via CLU, refer to the additional prerequisites described in Getting Started with DME CLU. 

  • No labels