S3Source should allow users to pass filesystem properties

Description

S3Source extends from FileBatchSource, but doesn't expose FileBatchSource's functionality to allow users to pass filesystem properties.

Release Notes

Added the ability for S3 Batch Source and Sinks to set additional file system properties.

Activity

Show:
Bhooshan Mogal
October 8, 2015, 1:13 AM

As part of this, also remove the fileSystem property from FileBatchConfig, and make S3BatchConfig extend from FileBatchConfig.

NitinM
October 8, 2015, 1:13 AM

Should be the same for Sink. The actual use-case is that one should be able to read .gz files from S3.

Bhooshan Mogal
October 13, 2015, 12:42 AM
Bhooshan Mogal
October 13, 2015, 5:14 AM

Merged PR.

Fixed

Assignee

Bhooshan Mogal

Reporter

Bhooshan Mogal

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Affects versions

Priority

Major
Configure