Amazon S3 Connection
Use this connection to access data in Amazon S3.
Configuration
Property | Macro Enabled? | Version Introduced | Description |
---|---|---|---|
Name | No | Â | Required. Name of the connection. Connection names must be unique in a namespace. Connection names can only include letters, numbers, underscores, and hyphens. |
Description | No | Â | Optional. Description of the connection. |
Authentication Method | Yes | Â | Authentication method to access S3. IAM can only be used if the plugin is run in an AWS environment, such as on EMR. Default is Access Credentials. |
Access ID | Yes | Â | Amazon access ID required for authentication. |
Access Key | Yes | Â | Amazon access key required for authentication. |
Session Token | Yes | 6.7.0 | Amazon session token required for authentication. Only required for temporary credentials. Temporary credentials are only supported for S3A paths. |
Region | Yes | Â | Region to be used by the S3 Client. Note: Region is only used to sample data in Wrangler. It is not used in the S3 batch source or sink plugins in data pipelines. |
Path of the connection
To browse, get a sample from, or get the specification for this connection through Pipeline Microservices, the path
 property is required in the request body. It’s an absolute Amazon S3 path of a file or folder.
Created in 2020 by Google Inc.