S3 Connection plugin has Region prop but S3 source doesn't have this field
Description
Release Notes
None
Activity
Show:
Amit Virmani July 8, 2021 at 5:42 AM
I believe the S3 source uses a different api and hence the difference. We will investigate and see if we can reconcile this without breaking compatibility.
Robin Rielley July 7, 2021 at 12:50 AM
@Amit Virmani For docs, can you tell me why sampling needs Region but source plugin doesn’t?
Amit Virmani June 29, 2021 at 5:31 AM
We discussed this internally. The region is present in current Wrangler as well. It is used for data sampling. The source doesnt use this.
The S3 batch source plugin doesn't have a property for Region, but the S3 Connection plugin does. Should the S3 batch source plugin also have this property?