Using Macros in Condition Expressions
CDAP macros can be specified within a condition expression. When a macro is specified in a condition, the data pipeline system will substitute a macro with the value specified at the runtime before the expression is compiled and executed. This provides a way for lazy substitution for the parts of the expression. Following are some of the examples for reference:
runtime['$variable1'] > token['$stage']['$variable2']
Macros $variable1
, $stage
 and $variable2
 are substituted before the compilation of expression. Let's assume the value associated with the macro $variable1
 is input
, $stage
 is Data Quality
 and $variable2
 is output
. Then the expression is converted at runtime to
runtime['input'] > token['Data Quality']['output']
Then, there should exist another runtime argument named input
 that should a numeric value and same holds true for plugin Data Quality
 that emits value for output
.
Created in 2020 by Google Inc.