Error while trying to overwrite non cacheable files while uploading to GCS

Description

At the line https://github.com/cdapio/cdap/blob/3cf83ab326d8e61be079ca0c5a72ae3ef7df8b9e/cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/runtimejob/DataprocRuntimeJobManager.java#L609, existing blob is being fetched from GCS and then the condition generationNotMatch [https://cloud.google.com/storage/docs/request-preconditions#precondition_criteria] is being used while attempting to upload the file. This is bound to fail as by retrieving the blob from GCS again, the generation number will always match

Release Notes

None

Activity

Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Affects versions

Triaged

Yes

Size

S

Components

Fix versions

Priority

Created February 7, 2024 at 11:36 AM
Updated February 9, 2024 at 3:37 PM
Resolved February 9, 2024 at 3:37 PM