Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Kafka pack 0.7 fails because ArtifactClassLoaderFactory loads scala classes from a later scala version

Description

ArtifactClassLoaderFactory loads spark classes at https://github.com/caskdata/cdap/blob/release/3.2/cdap-app-fabric/src/main/java/co/cask/cdap/internal/app/runtime/artifact/ArtifactClassLoaderFactory.java#L62, which brings needed classes from a higher version of scala (>2.8).
As a result, cdap-kafka-pack-0.7 fails with the following error:

Release Notes

Unit Test framework now has the capability to exclude scala, so users can depend on their own version of the library.

Activity

Show:

Ali AnwarSeptember 16, 2016 at 6:37 PM

PR to reduce the logging done upon Spark not being available in unit tests: https://github.com/caskdata/cdap/pull/6749

Ali AnwarSeptember 15, 2016 at 12:31 AM

PR in CDAP repo to make cdap-spark-core module excludable: https://github.com/caskdata/cdap/pull/6731
PR in CDAP Packs to make kafka-pack exclude cdap-spark-core: https://github.com/caskdata/cdap-packs/pull/71

Ali AnwarSeptember 14, 2016 at 11:38 PM

The issue observed now is similar to the one in the initial post. Kafka 0.8 test cases pass, but 0.7 test cases fail with the following issue:

Bhooshan MogalSeptember 14, 2016 at 12:10 AM

Support for Kafka 0.7 (even in unit tests) can't be dropped yet. Assigning to for further investigation.

Sreevatsan RamanAugust 12, 2016 at 12:14 AM

kafka 0.7 is 5+ years old. the effort to fix is huge. marking as won't fix.

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Affects versions

Components

Fix versions

Priority

Created September 23, 2015 at 3:06 AM
Updated October 5, 2016 at 12:44 AM
Resolved September 16, 2016 at 5:14 AM