CDAP Release 6.11.1

CDAP Release 6.11.1

Release date: Aug 27, 2025

Features

CDAP-21049: Added support for HTTP access tokens (Bearer authentication) in Bitbucket Server for source control management.

CDAP-21161: A new API is available to retrieve the application count for each namespace.

Changes

CDAP-21187: To create ephemeral Dataproc clusters, CDAP uses the Dataproc 2.3 image by default.

CDAP-21194: The pipeline JSON size limit for creating new pipelines and importing pipelines as JSON is increased to 5MB (previously 2MB).

CDAP-21195: On the Pipeline details page, the inbound triggers sidebar features a paginated list of pipelines where you can select the pipelines you want to add to the trigger. Additionally, a refresh button is added to update the existing list of triggers and pipelines.

CDAP-21163: Optimized the storage of application specification (ApplicationSpecification) by eliminating redundant plugin data from the database for spanner storage provider.

CDAP-21156: Added support for startupProbe in Router for CDAP deployed on k8s.

CDAP-21183: Added support for startupProbe in user interface container for CDAP deployed on k8s

Fixes

CDAP-21076: To prevent storage issues on static Dataproc clusters, temporary pipeline data is automatically deleted after a successful run.

CDAP-21204: Fixed an issue that prevented Expression Language (EL) from being used within user-defined directives.

PLUGIN-1717: Fixed an issue where a pipeline would fail when reading an encrypted file from Cloud Storage using Tink.

PLUGIN-1815: A previous issue with Database sink plugins has been fixed, where data mismatch would leave behind records from a Spark task. We've now implemented a rollback to prevent this.

PLUGIN-1846: When Source Bucket does not exist for GCS, instead of failing the pipeline with NPE, a proper error message gets displayed now.

Deprecated

  • Dataproc 2.1 is no longer supported in CDAP version 6.11.1 and later

 

Created in 2020 by Google Inc.