Page History

...

1. Log in as described in Logging In via the GUI. The Dashboard appears.
2. Select a method: 
   
   • If you are not familiar with the data destination, browse for it, as described in Browsing for Data via the GUI. Navigate to and right-click the collection where you want to register your data files. Click Add Bulk. 
   • If you are familiar with the data destination, select this method: Click Register tab > Bulk.
   The top portion of the Register Bulk Data page appears.
   Image Modified

3. Specify the data source:

   • To register data from Globus: 

     1. Select Globus and click Select Data from Globus Endpoint. A Globus page appears. 

     2. In Globus, select an endpoint.

     3. Select the files or folders that you want to register into DME.
     4. Click Submit. The Register Bulk Data page reappears, with information about your Globus selection at below the bottom of the Data Source sectionSelect Data from Globus Endpoint link.

     Image Modified

   • To register data from S3, select AWS S3:
     • Specify the name of the source S3 bucket.
     • Specify the path to and the name of the file or folder in the source bucket. 
     • Specify whether you are registering a file or a folder.
     • Specify the AWS access key.
     • Specify the AWS secret access key.
     • Specify the region

     

   • To register data from Google Drive: 
     1. Select Google Drive.
     2. Click Authorize DME to Access Your Google Drive. A Google page appears. Follow the prompts. The DME Register Bulk Data page reappears, indicating the successful generation of an access token. 
     3. Click Select Data from Google Drive. The Select Files or Folder dialog box appears.
     4. Navigate to and select the folder in which you want to transfer the data. Click Select. The DME Register Bulk Data page reappears, with information about your Google Drive selection at the bottom of the Data Source section.below the Select Data from Google Drive link.

     Image Added

4. If you want to provide required metadata for each object or collection, click Choose File. Navigate to and select the prepared metadata file. (For details, refer to Preparing a Metadata File for Bulk Registration.) 
   Image Modified

5. Scroll down to the remaining data source fieldsFilter panel. 
   Image ModifiedFinish specifying the

6. data sourceConsider the following filter options:

   Field	Instructions
   Include Criteria	Use patterns to specify the source files to include. If you specify more than one pattern, the system considers a union of all patterns. For details, refer to Specifying Include Criteria.
   Exclude Criteria	Use patterns to specify the source files to exclude. If you specify more than one pattern, the system considers a union of all patterns. For details, refer to Specifying Include Criteria.
   Criteria Type	Specify the type of patterns in your criteria: Simple: For details, refer to Specifying Include Criteria. RegEx: For details, refer to the following page: https://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html Multiexcerpt include MultiExcerptName ExitDisclaimer nopanel true PageWithExcerpt wikicontent:Exit Disclaimer to Include

   Dry RunIf you want to preview a list of the source file(s)/folder(s) that the system would register based on what you specified in the other Data Source fields, select this option. (This option tests only the Data Source entries. It does not test the Data Destination entries.)Bulk Metadata FileIf you want to provide required metadata for each object or collection, click Choose File. Navigate to and select the prepared metadata file. (For details, refer to Preparing a Metadata File for Bulk Registration.)

7. Scroll down to the remaining portions of the Register Bulk Data page. If you browsed to the data destination, that portion of the page has only the Collection Path field, with the path already specified. 
   Image Modified

8. If necessary, specify the data destination for the parent collection (the collection that will contain all of the new data):

   1. If the Base Path field is available, select the base path specified by your group administrator. An information icon () appears next to the Base Path field and the system begins to populate values in the Collection Type field and the Collection Path field.  
      Image Modified

      Consider examining the valid hierarchies for the selected base path. To do so, click the information icon next to the Base Path field. A Valid Hierarchies chart appears indicating the collection type or types allowed within each collection type. In the chart, a check mark indicates each collection in which you can register data files. 
      

      To close the Valid Hierarchies chart, click elsewhere on the page.

   2. If the Collection Type field is available, and if there is more than one collection type, select the one in which you want to register data. For guidance on selecting a collection type, refer to your group administrator. For some collection types, the system displays a list of required metadata attributes. 

   3. If necessary, append a forward slash (/) and a collection name to the system-generated collection pathIn the Collection Path field, specify the full path, including the base path and the name of the collection in which you intend to register bulk data. Avoid using invalid characters such as the space character, question mark (?), semicolon (;), backslash (\), or double quote ("). Consider the following example: 

      Collection Path

      Example

      System-generated

      Base path

      /SAMPLE_Archive

      User-modified

      Collection path

      /SAMPLE_Archive/Sample_Collection_Name

      The last collection in the path can be new or existing.  
      
      

9. Specify the metadata for the parent collection. The system applies this metadata to the entire collection, not to individual files:
   

   1. Include Page
      shared step - add metadata shared step - add metadata

      If you change your mind about adding an attribute, leave the name and value fields blank for that attribute. The system ignores a blank row. If you proceed to update the collection with a new attribute, the attribute name is permanent.

   2. Include Page
      shared step - specify attribute values shared step - specify attribute values

10. Click Register. The system checks whether it can access the objects and collections you have specified, using the data you have entered:

11. If not, the system displays an error message. 
If so, the system responds based on your selections and displays a message at the top of the Register Bulk Data page:If you selected the Dry Run option, the

If you want to preview a list of the source file(s)/folder(s) that the system would register based on what you specified in the Data Source fields, click Dry Run. (This option tests only the Data Source entries. It does not test the Data Destination entries.) The system displays a list of the source file(s)/folder(s) that it would have registered based on what you specified in the

other

Data Source fields. If necessary, revise your entries and click 

Register

Dry Run again until you are satisfied with the dry run list.

12. When you are ready to perform the registration,

    clear the Dry Run option and

    click Register. The system responds as follows:

    • The system checks whether it can access the objects and collections you have specified, using the data you have entered:

      • If not again.Otherwise, the system displays an error message. 
      • If so, the system responds based on your selections and displays a message at the top of the Register Bulk Data page a message with the task ID of the registration request. 
    • Depending on your event subscriptions, the system might send you an email notification of the registration status. For instructions on subscribing, refer to Subscribing to Notifications.
13. When the system displays the task ID, consider visiting clicking that link to visit the Data Registration Task Details page to page and view the progress of the registration. If you provided a metadata file, this page indicates any difficulty processing that metadata. For instructions, refer to Viewing Registration Status. 

...