If your user account has the Read, Write, or Own permission level on various collections, you can download those collections, from DME to an Amazon Web Services (AWS) S3 bucket.
To download multiple collections to S3:
Prepare an S3 bucket, as described in Preparing to use Amazon Web Services S3 with DME.
Run the following command:
dm_download_collection_s3 [optional parameters] [collection-logical-path] <destination S3 bucket> <destination-path> [AWS credentials file path]
[-D REST-response] : Optional, saves the response from the server to the specified file.
[-o output-json-file] : Optional, saves the output to the specified file.
[-f paths-file] : New line delimited file which contains the collection paths in DME to be downloaded. (Not needed if downloading a single collection using collection-logical-path parameter instead.)
[collection-logical-path] : Collection path in DME. (Not needed if the paths-file parameter is provided.)
<destination S3 bucket> : Destination S3 bucket to transfer data to. (This is a mandatory parameter.)
<destination-path> : Full path of the destination file/folder in the S3 bucket. (This is a mandatory parameter.)
[AWS credentials file path] : Optional location of the credentials file.
This command can be used to download a single collection or a list of collections provided in a file. (New line delimited.)
Single collection example:
dm_download_collection_s3 /Example_Archive/PI_Lab1/Project_1 testbucket testcollection
Multiple collections example:
collection-list.txt
/Example_Archive/PI_Lab1/Project_1
/Example_Archive/PI_Lab1/Project_2
/Example_Archive/PI_Lab2/Project_1
dm_download_collection_s3 -f collection-list.txt testbucket testcollection
