Flatten Record Transformation

The Flatten Record transformation plugin is available in the Hub (Hierarchy Plugins).

Plugin version: 1.0.0

The Flatten Record transformation flattens nested data structures.

You can use this transformation to convert a nested data structure into a single flattened record where each key in the record is a _ name path to the node in the nested structure.

Note: The plugin supports the flattening of records only. In order to flatten an array of records, first use Wrangler Flatten directive to flatten the array and then use the Flatten Record transformation.

Configuration

Property	Macro Enabled?	Description

Property

Macro Enabled?

Description

Fields to flatten

Yes

Required. Specifies the list of fields in the input schema to be flattened.

Level to limit flattening

Yes

Optional. Limit flattening to a certain level in nested structures.

Default is 1.

Example

For example the input record is as follows:

Address
    - Street  
    - City 
        - Name
        - Code
    - State
    - Zip

The output schema will be specified as:

Field

Field
Address_Street
Address_City_Name
Address_City_Code
Address_State
Address_Zip