Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Info

CDAP CDAPCDAP installation on Kubernetes was introduced in CDAP 6.2.3.

...

Starting in CDAP 6.7.0, you can run CDAP programs on Kubernetes using Spark.

Note: MapReduce and Spark Streaming engines are not supported.

In order to To run CDAP programs on Kubernetes, as a prerequisite the following service account and role binding needs to be created as a requirement from spark Spark.

  • Create service account

kubectl create serviceaccount spark

  • Create role binding

kubectl create clusterrolebinding spark-role --clusterrole=edit --serviceaccount=default:spark --namespace=default

Verify by running a pipeline

Run a pipeline using CDAP UI:

...

Limitations

coming soon

Appendix

This section describes how to create the resources required for the CDAP installation using Google Cloud Platform.

...