Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

Recommended: For better security and ease of use, use the GCS Argument Setter rather than the HTTP Argument Setter, which doesn’t provide authentication support and requires you to set up a web service.

Objectives

  • Use the GCS Argument Setter plugin to allow the pipeline to read different input in every run.

  • Use the GCS Argument Setter plugin to allow the pipeline to perform different quality checks in every run.

  • Use the GCS Argument Setter to ensure your data is secure during when you run a pipeline.

  • Write the output data of each run to Cloud Storage.

...