If your user account has the Read, Write, or Own permission level on various collections, you can download those collections, from DME to a Globus endpoint. For prerequisites, refer to Preparing to Use Globus with DME.
To download multiple collections to Globus:
Consider how you want to specify the Globus endpoint:
- If you want to use the default Globus endpoint in your hpcdme.properties file, as described in Getting Started with DME CLU, plan to omit the endpoint from the command.
- If you want to specify a different Globus endpoint, plan to include the endpoint in the command.
Run the following command:
dm_download_collection_async [optional parameters] [collection-logical-path] <globus-destination-path> [globus-endpoint]
Adding the command dm_download_collection_async to the CLU.
dm_download_collection_async [optional parameters] [collection-logical-path] <globus-destination-path> [globus-endpoint]
[-D REST-response] : Optional, saves the response from the server to the specified file.
[-o output-json-file] : Optional, saves the output to the specified file.
[-f paths-file] : New line delimited file which contains the collection paths in DME to be downloaded. (Not needed if downloading a single collection using collection-logical-path parameter instead.)
[collection-logical-path] : Collection path in DME. (Not needed if the paths-file parameter is provided.)
<globus-destination-path> : Path from the Globus endpoint where the collection(s) shall be downloaded. (This is a mandatory parameter.)
[globus-endpoint] : Optional Globus endpoint uuid if specifying other than the default endpoint.
This command can be used to download a single collection or a list of collections provided in a file. (New line delimited.)
Single collection example:
dm_download_collection_async /Example_Archive/PI_Lab1/Project_1 /
Multiple collections example:
collection-list.txt
/Example_Archive/PI_Lab1/Project_1
/Example_Archive/PI_Lab1/Project_2
/Example_Archive/PI_Lab2/Project_1
dm_download_collection_async -f collection-list.txt /