NIH | National Cancer Institute | NCI Wiki  

Error rendering macro 'rw-search'

null

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 22 Next »

If you need to move a large volume of data, you can do so using an AWS S3 bucket. DME uses AWS for high performance transfer of large files.

To prepare an S3 bucket:

  1. In AWS, create a bucket, create an access policy, create an IAM user, get access keys for that user, and set up permissions for the bucket, as described in AWS user documentation:
     https://docs.aws.amazon.com/s3/  Exit Disclaimer logo

  2. Gather required information: 
    • The name of the S3 bucket
    • The path to and the name of the relevant file or folder in that bucket 
    • The access key and secret key
    • The S3 region

    For instructions on locating this information, refer to AWS user documentation. 

  3. If you intend to use an S3 bucket with the DME CLU, continue as follows:

    1. Use a command line editor (such as vi editor) to create a file with the filename credentials that specifies S3 credential information, as follows:

      [default]
aws_access_key_id = <access key>
aws_secret_access_key = <secret access key>
region = <s3 region>

    2. Consider placing the credentials file in the default location for CLU commands, as follows:

      ~/.aws/credentials

Now you can upload or download data as described in the following pages:


  • No labels