Amazon AWS S3

ActiveBatch supports Amazon Simple Storage Service aka AWS S3.

 

Amazon Simple Storage Service (S3) is a service offered by Amazon Web Services (AWS) that provides storage for any type of object. This allows AWS S3 to provide storage services for a wide variety of environments. The data is managed by AWS S3 using object storage architecture which provides low latency, high availability, and easy scalability. Each object is given a user-assigned, unique key and organized into buckets. These buckets are managed using the AWS console, the AWS SDK, or the REST API.

 

 

Amazon S3 can be used to replace static web-hosting infrastructure with HTTP client-accessible objects, index document support, and error document support.

 

 

Login

Sets authenticated session for subsequent S3 job steps.

 

 

Job Step Properties

 

Connection: Connection is optional for all Job Steps except Login. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

User Account: Requires an AWS Access Key ID and Secret Access Key.

 

Username (AWS Access Key)/Password (Secret Access Key).

 

Region: Enter the AWS Region. By default, AWS uses us-east-1.

 

List Objects

List all objects or a subset based on a prefix.

 

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Bucket Name: Required to specify the bucket name.

 

Prefix: A prefix can be used to organize the data stored in S3 buckets by using a string of characters before the object key name. Prefixes allow you to store

data in the same way as file system directories.

 

Delete Object

 

Deletes an object specified by a file key.

 

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Bucket Name: Required to specify the bucket name.

 

File Key: The AWS Object Key. This field can also include a prefix. For example,

 

test/mytestfile

 

Download

 

Downloads the specified file.

 

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Bucket Name: Required to specify the bucket name.

 

File Key:The AWS Object Key. This field can also include a prefix. For example,

 

test/mytestfile

 

Target File Path: Specifies the local file path the job is executing on.

 

Specify a File path specification that is present on the local system the job is executing on

 

 

List Buckets

Returns a list of all buckets owned by the authenticated sender of the request.

 

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

 

Upload

 

Uploads the specified file.

 

 

Job Step Properties

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Bucket Name: Required to specify the bucket name.

 

File Key:

 

Source File Path: Specifies the local file path the job is executing on.

 

Copy

 

Copy an Object from one location to another.

 

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Source Bucket: The name of the bucket where the source object is located.

 

Source Key: The key (path and filename) of the source object to copy.

 

Destination Bucket: The name of the object where the source object will be copied.

 

Destination Key: The key (path and filename) where the source object will be copied.

 

Move

 

Move an Object from one location to another.

 

 

Connection: If not specified by the Login Job Step, this field is required. Select Connection Data from the drop-down menu and enter a User Account and

Region.

 

Source Bucket: The name of the bucket where the source object is located.

 

Source Key: The key (path and filename) of the source object to move.

 

Destination Bucket: The name of the object where the source object will be moved.

 

Destination Key: The key (path and filename) where the source object will be moved.