...
You are now set up to use rclone to move data to/from your Acacia storage.
AWS Client
Configuration for aws
| Code Block | ||
|---|---|---|
| ||
user@setonix:~> tee -a $HOME/.aws/credentials <<EOF
[<profilename>]
aws_access_key_id=
aws_secret_access_key=
EOF
user@setonix:~> tee -a $HOME/.aws/config <<EOF
[profile <profilename>]
output=json
EOF |
To use aws client commands, you will need to load the aws client module:
| Code Block | ||||
|---|---|---|---|---|
| ||||
module load awscli/1.16.308 #Garrawarla
module load aws-cli/2.13.0 #Setonix |
To create a new bucket using AWS S3 CLI, use the S3 mb command:
...
> aws --endpoint-url=https://projects.pawsey.org.au --profile=<PROFILE_NAME> s3 cp <SOURCE> s3://<bucket>/<TARGET>
Where:
<SOURCE>is the filesystem path and name of the file you want to upload.<TARGET>is the key of the object on Acacia, so bucket name, pseudo folder (optional), and object name. You can specify any object name to “rename” the file on upload.
...
> aws --endpoint-url=https://projects.pawsey.org.au --profile=<PROFILE_NAME> s3 cp s3://<bucket>/<SOURCE> <TARGET>
Where:
<SOURCE>is the key of the object on Acacia you want to download, so bucket name, pseudo folder (optional), and object name.<TARGET>is the filesystem path where you want the object to be downloaded to.
...