Filter Row directive

The FILTER-ROW directive filters records based on a condition.

Syntax

filter-row exp:{<condition>} [type (true/false)]

Usage Notes

The FILTER-ROW directive applies the filter type and a boolean or regular expression on a column value for each record. If the expression matches or returns true for the column value, then the record is omitted; otherwise, it is passed on as-is to the input of the next directive.

Example

Using this record as an example:

{
  "id": 1,
  "name": "Joltie, Root",
  "emailid": "jolti@hotmail.com",
  "hrlywage": 12.34,
  "gender": "Male",
  "country": "US"
}

Applying this directive:

filter-row condition-true country !~ 'US'

would result in filtering out records for individuals that are not in the US (where country does not match "US").

Applying this directive:

filter-rows-on condition-true (country !~ 'US' && hrlywage > 12)

would result in filtering out records for individuals that are not in the US (where country does not match "US") and whose hourly wage (hrlywage) is greater than 12.

CDAP Documentation

Filter Row directive

Syntax

Usage Notes

Example

Related content