NIH | National Cancer Institute | NCI Wiki  

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Added a link.

If you need to move a large volume of data, you can do so using a Globus endpoint. The system uses Globus for high performance transfer of large files. Endpoints represent locations on a file transfer service server, such as gridftp. A prerequisite is a shareable Globus endpointis a guest collection.

To prepare a Globus endpoint:

  1. Log into Globus at the following site:
    http://www.globus.org
    Multiexcerpt include
    MultiExcerptNameExitDisclaimer
    nopaneltrue
    PageWithExcerptwikicontent:Exit Disclaimer to Include

    Use your user account credentials as described in the following page:
    https://docs.globus.org/how-to/get-started/
    Multiexcerpt include
    MultiExcerptNameExitDisclaimer
    nopaneltrue
    PageWithExcerptwikicontent:Exit Disclaimer to Include
  2. If you do not already have a guest collection in Globus, create one:

    Panel
    borderColorblack
    borderStylesolid
    Expand
    titleInstructions to Create a Guest Collection
    1. In the Globus File Manager, open the side bar and click Endpoints. On the Endpoints page, search for and select search for NIH HPC Data Transfer (Biowulf). This is a public endpoint. 
      Results of searching for NIH HPC Data Transfer on the Globus Endpoints page.Image RemovedResults of searching for NIH HPC Data Transfer in Globus.Image Added
    2. In the search results, in the row for On the NIH HPC Data Transfer page(Biowulf), click Collections. On the collection details icon (The collection details icon in Globus.Image Added). The details page appears. On the Collections tab, click Add a Guest Collection
      Collections tab on the NIH HPC Data Transfer page in Globus.Image RemovedCollections tab on the NIH HPC Data Transfer page in Globus.Image Added
    3. On the Create New new Guest Collection page, browse to or specify the path to the directory where you want to save your data. Click Create ShareGuest Collection
      The the Create New Guest Collection page in Globus.Image RemovedThe Create new GCSV4 Share page in Globus.Image Added
  3. Share your Globus endpoint:
    1. In the Globus File Manager, navigate to the list of endpoints collections by opening the side bar, clicking Endpoints Collections, and then clicking Shareable by You

      Shareable by You tab on the Globus Endpoints page.Image RemovedList of collections that are shareable by you in Globus.Image Added
    2. Select the endpoint you want to useyour guest collection. Access the sharing configuration for that endpoint collection by clicking Permissions

      Permissions tab for a particular endpoint in Globus.Image RemovedPermissions tab for a particular collection in Globus.Image Added
    3. Add permissions by clicking Add Permissions - Share With. In the Share With field, select the option to share with a group. Click Select a Group.

      Add Permissions - Share With page in Globus.Image Modified
    4. Search all groups for "MODAC" and select MODAC-PROD-App-Accts-Pool-NCI_DOE.

      Search for a Group page in Globus.Image Added

    5. Select the appropriate permission for the selected group: If you intend to download data to the Globus endpoint, select the write permission. 

      Add Permissions - Share With page, with group and permissions selected.Image Added

    6. Click Add Permission. The system adds the MODAC-PROD-App-Accts-Pool-NCI_DOE Globus group to the list for the current share.  

Now you can upload or download data as described in the following pages: