NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 28 Next »

This page is a work in progress.

If your user account has the Write or Own permission level on an existing collection in DME, and if that existing collection has been configured to contain another collection, you can copy data from your file system to that existing collection. The following command recursively copies files and directories from the directory specified in the <source-path> to the <destination-path> in DME. 

dm_register_directory [OPTIONS] <source-path> <destination-path>

The following table describes each option:

OptionDescription
-a[ARCHIVE_TYPE]

Specify the type of the archive. Valid values are as follows:

  • S3
  • POSIX
-c
Turn off checksum calculation.
-d

Unable to render {include} The included page could not be found.

-e[EXCLUDE_FILE_PATH]Exclude the files that match the patterns specified in the file EXCLUDE_FILE_PATH.
-hPrint a usage message.
-i[INCLUDE_FILE_PATH]Include the files that match at least one of the patterns specified in INCLUDE_FILE_PATH.
-l[FILES_LIST]Register the files mentioned in the FILE_LIST only. Each line in the FILES_LIST file contains a relative path to the source-path. All collections should be registered before using this option.
-mRegister metadata only. Do not register files.
-sSkip confirmation prompt and register directly.
-t[NUM_THREADS]Specify the number of threads to use while copying files to Cleversafe. This number should be between [1, 32].

By default, the dm_register_directory command copies all files and directories in the source directory. To register a subset of the files in the source directory, use the -e option, the -i option, or both. Use regular expression patterns in the files that you specify with those options. For information, refer to Specifying Criteria for Bulk Upload. The system first identifies files that match any of the include regular expression patterns. Then the system removes from the registration job the files that match any of the exclude patterns. 

The following table describes each parameter:

ParameterDescription
<source-path>
A path in your file system, specifying the data that you want to copy. The system copies the contents of the folder you specify.
<destination-path>
A path within DME, specifying where you want the system to create the new collection.

Metadata can be provided for each directory and file in a specific metadata file called <[directory,filename]>.metadata.json. The metadata file should exist in the same path in its corresponding directory/file. For example, the metadata for the file sample.txt should be sample.txt.metadata.json. 

For instructions on performing similar tasks in the GUI, refer to the following pages:


  • No labels