NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 30 Next »

This page is a work in progress.

If your user account has the Write or Own permission level on an existing collection in DME, and if that existing collection has been configured to contain another collection, you can copy data from your file system to that existing collection. The following command recursively copies files and directories from the directory specified in the <source-path> to the <destination-path> in DME. 

dm_register_directory [OPTIONS] <source-path> <destination-path>

The following table describes each option:

OptionDescription
-a[ARCHIVE_TYPE]

Specify the type of the archive. Valid values are as follows:

  • S3
  • POSIX
-c
Turn off checksum calculation. By default, the system performs this calculation as a validation procedure. However, it can increase the time required to run the command, depending on the file size.
-d

Unable to render {include} The included page could not be found.

-e[EXCLUDE_FILE_PATH]Exclude the files that match the patterns specified in the file EXCLUDE_FILE_PATH.
-hPrint a usage message.
-i[INCLUDE_FILE_PATH]Include the files that match at least one of the patterns specified in INCLUDE_FILE_PATH.
-l[FILES_LIST]Register the files mentioned in the FILE_LIST only. Each line in the FILES_LIST file contains a relative path to the source-path. All collections should be registered before using this option.
-mRegister metadata only. Do not register files.
-sSkip confirmation prompt and register directly.
-t[NUM_THREADS]If you want to process the files more efficiently with a smoother upload, consider specifying the number of threads to use while copying files to Cleversafe. This number should be between [1, 32]. Your network and the server directly impact the way the system transfers files. You can set the number of threads so the system has enough memory while processing massive files.

By default, the dm_register_directory command copies all files and directories in the source directory. To register a subset of the files in the source directory, use the -e option, the -i option, or both. Use regular expression patterns in the files that you specify with those options. For information, refer to Specifying Criteria for Bulk Upload. The system first identifies files that match any of the include regular expression patterns. Then the system removes from the registration job the files that match any of the exclude patterns. 

The following table describes each parameter:

ParameterDescription
<source-path>
A path in your file system, specifying the data that you want to copy. The system copies the contents of the folder you specify.
<destination-path>
A path within DME, specifying where you want the system to create the new collection.

Metadata can be provided for each directory and file in a specific metadata file called <[directory,filename]>.metadata.json. The metadata file should exist in the same path in its corresponding directory/file. For example, the metadata for the file sample.txt should be sample.txt.metadata.json. 

For instructions on performing similar tasks in the GUI, refer to the following pages:


  • No labels