...
CDAP allows you to write Spark programs using either Spark 2 or Spark 3 .
To use Spark 2, you must add the cdap-api-spark2_2.11
Maven dependency:
Code Block |
---|
. . .
<dependency>
<groupId>io.cdap.cdap</groupId>
<artifactId>cdap-api-spark2_2.11</artifactId>
<version>${cdap.version}</version>
</dependency>
. . . |
To use Spark 3with Scala 2.12.
To use it, you must add the cdap-api-spark3_2.12
Maven dependency:
...