Amazon S3 Connection

Use this connection to access data in Amazon S3.

Configuration

Property

Macro Enabled?

Version Introduced

Description

Property

Macro Enabled?

Version Introduced

Description

Name

No

 

Required. Name of the connection. Connection names must be unique in a namespace. Connection names can only include letters, numbers, underscores, and hyphens.

Description

No

 

Optional. Description of the connection.

Authentication Method

Yes

 

Authentication method to access S3. IAM can only be used if the plugin is run in an AWS environment, such as on EMR.

Default is Access Credentials.

Access ID

Yes

 

Amazon access ID required for authentication.

Access Key

Yes

 

Amazon access key required for authentication.

Session Token

Yes

6.7.0

Amazon session token required for authentication. Only required for temporary credentials. Temporary credentials are only supported for S3A paths.

Region

Yes

 

Region to be used by the S3 Client.

Note: Region is only used to sample data in Wrangler. It is not used in the S3 batch source or sink plugins in data pipelines.

Path of the connection

To browse, get a sample from, or get the specification for this connection through Pipeline Microservices, the path property is required in the request body. It’s an absolute Amazon S3 path of a file or folder.

Created in 2020 by Google Inc.