S3 Connection plugin has Region prop but S3 source doesn't have this field

Description

The S3 batch source plugin doesn't have a property for Region, but the S3 Connection plugin does. Should the S3 batch source plugin also have this property?

Release Notes

None

Activity

Show:

Amit Virmani July 8, 2021 at 5:42 AM

I believe the S3 source uses a different api and hence the difference. We will investigate and see if we can reconcile this without breaking compatibility.

Robin Rielley July 7, 2021 at 12:50 AM

For docs, can you tell me why sampling needs Region but source plugin doesn’t?

Amit Virmani June 29, 2021 at 5:31 AM

We discussed this internally. The region is present in current Wrangler as well. It is used for data sampling. The source doesnt use this.

Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Components

Fix versions

Affects versions

Priority

Created June 22, 2021 at 11:42 PM
Updated July 8, 2021 at 5:42 AM