Versioning data pipelines

The Pipeline Studio doesn’t integrate with version control systems. If you want to implement version control for data pipelines, you can do this manually.

To implement version control for data pipelines, in the Pipeline Studio, export the pipeline. When you export a pipeline, CDAP saves the pipeline configuration to your local drive as a JSON file.  The JSON includes all of the plugin configuration and pipeline configuration, including comments.

All pipelines are exported in the DRAFT state.

For more information, see Exporting and importing data pipelines.

You can also use the Lifecycle Microservices to update and deploy pipelines that you’ve checked into a version control system.

 

Created in 2020 by Google Inc.