We're updating the issue view to help you get more done. 

AutoJoins should output byte[] instead of ByteBuffer

Description

AutoJoin implementation uses DataFrames.fromRow() to transform a Row into a StructuredRecord. In this process, byte fields get transformed into ByteBuffers, which cause issues in some plugins (like Wrangler) as well as in other Spark situations, as ByteBuffer is not serializable.

Using a byte[] is more likely to be safer

Release Notes

None

Activity

Show:
Albert Shau
June 12, 2020, 11:00 PM
Albert Shau
June 12, 2020, 11:30 PM
Fixed

Assignee

Albert Shau

Reporter

Albert Shau

Labels

None

Docs Impact

None

UX Impact

None

Fix versions

Priority

Major
Configure