BigQuery sink should ignore URI scheme for bucket name if present
Description
The BigQuery sink expects a temporary GCS bucket name as an optional parameter. If a user specifies a fully qualified bucket name including the gs:// scheme, the plugin should strip out the gs://.
Had an offline discussion with . Since there are many instances where users made mistake of using `gs://` scheme in the bucket name, we decided to remove `gs://` scheme if user has specified it in the bucket name.
Albert Shau May 1, 2019 at 4:45 PM
The GCS plugins allow users to specify a path with or without the gs:// so we should make sure the bigquery plugin does as well. Should just be a special case if it is prefixed by gs://, then remove it.
Vinisha Shah May 1, 2019 at 2:33 AM
This is intended behavior as the plugin config expects users to enter bucket name and bucket name does not allow `/` in the path. However, this validation should happen before the pipeline is deployed.
Fixed
Pinned fields
Click on the next to a field label to start pinning.
The BigQuery sink expects a temporary GCS bucket name as an optional parameter. If a user specifies a fully qualified bucket name including the gs:// scheme, the plugin should strip out the gs://.