Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The column specifies the column in the record that should be parsed as CSV using the specified delimiter. If the values in the first record of the input need to be set as column headers, set header to true; by default, it is set to false

This directive supports reading the first record as a header. However this should not be used in most situations, because the header is not guaranteed to be the first record processed. For example, this can happen when an input file is broken up into multiple pieces. Instead, make sure the pipeline source is configured to use the correct schema. If your input files contain headers, configure the source to skip the header so that it is not read as data.

Examples

Consider a single line from a consumer complaint CSV file. Each line of the CSV file is added as a record:

...