ClassCastException when doing unions with DatasetCollection

Description

Error: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to io.cdap.cdap.api.data.format.StructuredRecord at io.cdap.wrangler.Wrangler.transform

Root cause: https://issues.apache.org/jira/browse/SPARK-46176

Release Notes

n/a

Activity

Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Affects versions

Triaged

Yes

Size

S

Components

Fix versions

Due date

Priority

Created November 30, 2023 at 1:13 AM
Updated December 1, 2023 at 4:43 PM
Resolved December 1, 2023 at 4:43 PM