We're updating the issue view to help you get more done. 

Support Stream FormatSpecification in Spark

Description

If you use the StreamBatchSource with a format and schema, it does not work using the Spark engine.

It seems like the format spec from:

is not used in spark, but is in mapreduce.

As a result, we get an exception like:

Release Notes

Added support for FormatSpecification in Spark when consuming data from Stream

Activity

Show:
Terence Yim
April 14, 2016, 12:08 AM

I think it's the same behavior in the old Spark runtime as well. It's a new feature we add to Spark in CDAP.

Terence Yim
April 14, 2016, 10:03 AM

Assignee

Terence Yim

Reporter

Albert Shau

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Priority

Major
Configure