Flatten Record directive

The FLATTEN-RECORD directive was introduced in CDAP 6.7.0.

The FLATTEN-RECORD directive splits a record column with nested values into multiple columns. To flatten an array, use the FLATTEN directive.

Syntax

flatten-record :column [,:column]*

The column is the name of a record column with nested values.

Usage

The directive takes multiple columns of type "Row" and brings all its elements up a level. Topmost elements will be set under new columns prefixed with the name of the parent column followed by an underscore. Existing columns with the same name will be replaced by the new values.

Example

Directive:

flatten-record :A

The record in column A is flattened.

Input Record:

| A |
{B: 1, C: 2}

Output Record:

| A          | A_B | A_C |
{B: 1, C:2}  | 1   |  2 |