Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The plugin is used when you want to capture errors emitted from another stage and pass them along with all the error information flattened into the record. For example, you may might want to connect a sink to this plugin in order to store and later examine the error records.

You might want to add an The Error Collector after a Wrangler transformation to store error records. See takes inputs from a previous stage that outputs errors, such as the Wrangler transformation. For more information, see Sending records to error.

Configuration

Property

Macro Enabled?

Description

Error Message Column Name

No

Optional. The name of the error message field to use in the output schema. The UI will default this to ‘msg’. If no value is specified, the error message will be dropped.

Error Code Column Name

No

Optional. The name of the error code field to use in the output schema. The UI will default this to ‘code’. If no value is specified, the error code will be dropped.

Error Emitter Node Name

No

Optional. The name of the error stage field to use in the output schema. The UI will default this to ‘Stage’. If no value is specified, the error stage will be dropped.

Output Schema

No

Required. The output schema of the data.

...