File based sources should have an optional field for source file

Description

It would be nice if the File based source plugins had an option to include the file path the record was read from as a field in the output record. Not sure if this can always be done, as it depends on the input format being used.

For example, FileSplit has a way to get the path, but something like CombineFileSplit is across multiple paths.

Release Notes

None

Activity

Show:
Duplicate
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Components

Priority

Created October 10, 2016 at 10:40 PM
Updated July 17, 2020 at 12:27 AM
Resolved June 7, 2017 at 9:38 PM