Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

CDAP allows you to write Spark programs using either Spark 2 or Spark 3 .

To use Spark 2, you must add the cdap-api-spark2_2.11 Maven dependency:

Code Block
. . .
<dependency>
  <groupId>io.cdap.cdap</groupId>
  <artifactId>cdap-api-spark2_2.11</artifactId>
  <version>${cdap.version}</version>
</dependency>
. . .

To use Spark 3with Scala 2.12.

To use it, you must add the cdap-api-spark3_2.12 Maven dependency:

...