Fetch google-cloud jar from cache for tethered runs when BQ pushdown is enabled
Description
When BigQuery pushdown is enabled, we are fetching google-cloud jar from remote appfabric instead of the local artifact cache, adds a delay of several minutes in pipeline execution.
We can see this in the log lines pasted below - there’s a 11+ minute gap between when the program was dispatched and the workflow pod started running.
Release Notes
None
Activity
Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.
When BigQuery pushdown is enabled, we are fetching google-cloud jar from remote appfabric instead of the local artifact cache, adds a delay of several minutes in pipeline execution.
We can see this in the log lines pasted below - there’s a 11+ minute gap between when the program was dispatched and the workflow pod started running.