If your user account has the Read permission level on various collections, you can submit one or more of those collections, from DME to dbGaP (Aspera).
To submit one or more collections to dbGaP:
Decide whether you want to submit a single collection or multiple collections:
- To submit a single collection: Plan to specify the path for that collection in the command.
- To submit multiple collections: In your local system, use a command line editor (such as vi editor) to create a file that lists the paths for all of the DME collections you want to submit, delimited by newline. Plan to use the -f option to specify that file in the command.
Run the following command:
(dm_download_collection_aspera [optional parameters] [DME data path] <destination bucket> <destination-path> [Aspera credentials file path])The following table describes each parameter:
Parameter Description [-D <REST-response>]
An optional parameter, specifying a path and filename in your local system. The system always creates a response file:
- If you specify this parameter, the system saves the response from the server to the specified file in the specified location.
- If you omit this parameter, the system saves the file as download-collection-response-header.tmp in your home directory.
[-o <output-json-file>]
An optional parameter, specifying a path and filename in your local system. The system always creates an output file:
- If you specify this parameter, the system saves the output to the specified file in the specified location.
- If you omit this parameter, the system saves the output as download-collection-response-message.json.tmp in your home directory.
If the command is successful, the output file is empty.
[-f <paths-file>]
or
[DME data path]
One or more paths within DME. Select one of the following methods to specify the collection or collections that you want to submit:
- To specify multiple collections, use the -f parameter to specify a path and filename in your local system, of a file that lists the paths for all of the DME collections you want to submit, delimited by newline.
- To specify a single collection, specify the path for the DME collection you want to submit.
<destination bucket>
The name of the destination Aspera bucket. <destination path>
The path to and the name of the folder in the Aspera bucket. Do not begin the path with a slash. If the destination folder structure you specify does not already exist, DME creates it. [Aspera credentials file path]
The location of the credentials file.
For some examples, refer to the following code specified in a credentials file:
ASPERA_HOST=gap-submit.ncbi.nlm.nih.gov ASPERA_USER=asp-dbgap ASPERA_SCP_PASS=1234abcf-12c6-de34-9876abc7e543
If you omit ASPERA_HOST or ASPERA_USER, then the command uses dbGaP supplied values.
Single Collection Example
The following example uses the credentials file in a non-default location to submit a collection from DME.
In this example, the command performs the following:
- Locates or creates a folder1 folder in the bucket1 bucket.
- Locates or creates a subfolder1 folder within the folder1 folder.
- Submits from DME all files in the Project_1 collection.
- Saves those files in the subfolder1 folder with the same file names they have in DME.
Multiple Collections Example
For another example, refer to the following command.
With the following code in the specified collection-list.txt file, the above command uses the credentials file in a default location to submit multiple collections from various locations in DME.
/Example_Archive/PI_Lab2/Project_1 /Example_Archive/PI_Lab2/Project_2 /Example_Archive/PI_Lab3/Project_1
In this example, the command performs the following:
- Locates or creates a folder1 folder in the bucket1 bucket.
- Locates or creates a subfolder1 folder within the folder1 folder.
- Submits from DME all files in the collections listed in the specified collection-list.txt file.
- Saves those files in the subfolder1 folder with the same file names they have in DME.