When using CDAP BigQuery sink fails to read ProjectID

Description

BigQuerySink throws IllegalArgumentException and fails to read the projectID from the builder or the environment when doing Update/Upsert operation
Caused by: java.lang.IllegalArgumentException: A project ID is required for this service but could not be determined from the builder or the environment. Please set a project ID using the builder.
Block of code that needs to be fixed:
https://github.com/data-integrations/google-cloud/blob/86f4b91d9bf2916f48ba9fd12aacacecc8e805e5/src/main/java/io/cdap/plugin/gcp/bigquery/sink/BigQueryOutputFormat.java#L526-L547

This error occurs in cdap since in CDF auto-detect works around this.

Release Notes

None

Activity

Show:
Vinisha Shah
February 18, 2021, 4:50 AM

Does it apply to multi sink as well?

Bajram Bojku
February 18, 2021, 5:18 AM

I’m not sure. Would need to look at the code for multi-sink to confirm.

Assignee

Unassigned

Reporter

Bajram Bojku

Labels

None

Dev Complete Date

None

Publish Date

None

Reviewer

None

Sprint

Cirus Sprint 6

Priority

Major