Google Cloud BigQuery Argument Setter Action

Plugin version: 0.22.0

Performs an BigQueryTable Query request to fetch arguments to set in the pipeline.

This is most commonly used when the structure of a pipeline is static, and its configuration needs to be managed outside the pipeline itself.

Arguments name must match column name in BigQueryTable.

Credentials

If the plugin is run on a Google Cloud Dataproc cluster, the service account key does not need to be provided and can be set to ‘auto-detect’. Credentials will be automatically read from the cluster environment.

If the plugin is not run on a Dataproc cluster, the path to a service account key must be provided. The service account key can be found on the Dashboard in the Cloud Platform Console. Make sure the account key has permission to access BigQuery and Google Cloud Storage. The service account key file needs to be available on every node in your cluster and must be readable by all users running the job.

Configuration