Implement Spark lookups Hydrator plugin

Description

Customer reported:
Previous run slightly different javascript, I got exception message: "Lookup is not supported in Spark pipelines.]” and the current run also generate exception but both the exception name and message are empty.
And asking to implement Spark lookups.

Release Notes

None

Activity

Show:

Albert Shau April 18, 2017 at 10:42 PM

It's not fixed yet. The Fix Version field is the release that the fix is targeted for (4.2.0)

Krish Suri April 18, 2017 at 8:59 PM

Hi there,

Is this issue fixed? If so, which version is it fixed in? I see the issue was created for 3.6.0 but I still see the exception in 4.1.0 when trying to use Lookup from a KVTable in Spark pipelines:

"java.lang.IllegalArgumentException: Could not transform input: Lookup is not supported in Spark pipelines."

Please advise.

Thanks,
Krish.

Won't Fix
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Affects versions

Components

Priority

Created January 23, 2017 at 7:33 PM
Updated July 17, 2020 at 12:27 AM
Resolved June 15, 2020 at 11:41 PM