Flatten Record Transformation
- Robin Rielley
The Flatten Record transformation plugin is available in the Hub (Hierarchy Plugins).
Plugin version: 1.0.0
The Flatten Record transformation flattens nested data structures.
You can use this transformation to convert a nested data structure into a single flattened record where each key in the record is a _ name path to the node in the nested structure.
Note: The plugin supports the flattening of records only. In order to flatten an array of records, first use Wrangler Flatten directive to flatten the array and then use the Flatten Record transformation.
Configuration
Property | Macro Enabled? | Description |
|---|---|---|
Fields to flatten | Yes | Required. Specifies the list of fields in the input schema to be flattened. |
Level to limit flattening | Yes | Optional. Limit flattening to a certain level in nested structures. Default is 1. |
Example
For example the input record is as follows:
Address
- Street
- City
- Name
- Code
- State
- Zip The output schema will be specified as:
Field |
|---|
Address_Street |
Address_City_Name |
Address_City_Code |
Address_State |
Address_Zip |
Created in 2020 by Google Inc.