...
Note: The sink operation will use the existing workflow and not execute a direct copy if the above mentioned conditions are not met.
Group By Aggregation (6.7.0+)
Group By Aggregations can be executed in BigQuery when the following aggregation operations are in use:
...
The Group By aggregation stage follows a stage that has already been pushed down.
The Group By aggregation stage is configured as a stage that should be executed in BigQuery using the Stages to force pushdown option.
Deduplicate Aggregation (6.7.0+)
Deduplicate aggregations can be executed in BigQuery when the following Filter Operations are configured:
...
The service account configured for BigQuery Transformation Pushdown must have permissions to read tables in the BigQuery Source's dataset.
The Datasets used in the BigQuery Source and the dataset configured for Transformation Pushdown must be stored in the same location.
Wrangler Precondition Pushdown (6.9.0+)
Wrangler Precondition Pushdown is available in CDAP versions 6.9.0 and later. It lets you push down Precondition operations in the Wrangler plugin to BigQuery.
Wrangler Precondition Pushdown is only supported with the SQL mode for Preconditions, also newly added in 6.9.0. In this mode, the plugin accepts a precondition expression in ANSI-standard SQL.
If the SQL mode is used for preconditions, Directives and User Defined Directives are disabled for the Wrangler transformation plugin as they are not supported along with preconditions in SQL mode.
SQL mode for preconditions is currently unsupported for Wrangler plugins with multiple inputs.
Wrangler preconditions are executed in BigQuery in the following cases:
It follows a stage that has already been pushed down.
You configured it to be executed in SQL Engine (see the Stages to force execution property).
Window Aggregations Pushdown (6.9.0+)
Transformation Pushdown is available for Window aggregations in CDAP version 6.9.0 and later. Window aggregations in BigQuery are available for the following functions are supported for BigQuery Transformation Pushdown:
Rank
Dense Rank
Percent Rank
N tile
Row Number
Median
Continuous Percentile
Lead
Lag
First
Last
Cumulative distribution
Accumulate.
Window aggregations are executed in BigQuery in the following cases:
It follows a stage that has already been pushed down.
You configured it to be executed in SQL Engine (see the Stages to force execution property).
How Transformation Pushdown works
...