NIH | National Cancer Institute | NCI Wiki  

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Replaced "file system" with "local system" for HPCDATAMGM-1598.

...

You can also use the CLU to create an empty collection. 

The character limit for each metadata value is 2700.

The following table compares the functionality available with each command: 

CommandData TypeSourcePre-signed 1 MultipartCommand Allows You To File SizeUpdate MetadataMetadata Extraction1

dm_register_dataobject 

(Using dm_register_dataobject and Updating Data File Metadata via the CLU)

1 file and metadata

Register a new file with metadata.

or

Update metadata of an existing file.

Up to 2 TB from

File system (up to 10 GB),

Globus, AWS S3, or Google Cloud storage

No

Yes, if the file is 50 MB

or

largerYes

Up to 10 GB from local system

Yes, for file local system

dm_register_dataobject_presigned 

(Using dm_register_dataobject_presigned)

1 Register a new file and with metadata.File system (up Up to 2 GB (recommendation) )YesNofrom local systemNoNo

dm_register_dataobject_multipart 

(Using dm_register_dataobject_multipart)

1 Register a new file and with metadataFile systemYesYes, if the file is 50 MB or largerNoNo.Up to 2 TB from local systemNo

dm_register_collection

(Creating an Empty Collection via the CLU and Updating Collection Metadata via the CLU)

MetadataNANANA

Register a new collection with metadata.

or

Update metadata for an existing collection.

NAYesNA

dm_register_directory

(Registering Directory Contents from Your File Local System via the CLU)

1 collection Register a new collection from a specified directory (including subcollections subdirectories and files) and with metadata.Up to 2 TB from local File systemYesYes, if the file is 50 MB or largerYesYes

Anchorfootnotefootnote1 In the Pre-signed column, "Yes" indicates that the command gets a pre-signed URL from DME and uses it to register data directly into the NCI Data Vault, instead of through DME. Footnote 1: In the Metadata Extraction column, a "Yes" indicates you can extract metadata from the header of TIFF or BMP image files.