The Fast Filter transformation (Spark) plugin is available in the Hub.
Plugin version: 1.8.0
Filters out messages based on a specified criteria. You can use this transformation in pipelines that use the Spark execution engine.
Configuration
Property | Macro Enabled? | Description |
|---|---|---|
Source Field | No | Required. Specifies the source field to use for the filter. If the value in the Source Field is null, the record is dropped. |
Operator | No | Required. Specifies the operator to use for the comparison. Default is contains. |
Criteria | Yes | Required. Specifies the criteria to use for the filter. |
Ignore Case? | No | Required. Select true if you’d like the filter to ignore case. Default is false. |