Log additional information when launching the Dataproc cluster.
Activity
Show:
Vitalii Tymchyshyn November 13, 2020 at 5:38 PM
Implemented in https://github.com/cdapio/cdap/pull/12857
Fixed
Pinned fields
Click on the next to a field label to start pinning.
Details
Details
Assignee
Vitalii TymchyshynReporter
Sagar KapareLabels
Affects versions
Components
Fix versions
Priority
MajorCreated July 17, 2019 at 9:25 PM
Updated January 13, 2021 at 1:52 AM
Resolved November 13, 2020 at 5:39 PM
It would be useful to log additional information such as runtime argument when launching Dataproc cluster here - https://github.com/cdapio/cdap/blob/60208908ab3d54c426fffa5781ebb9eff0192eb0/cdap-runtime-ext-dataproc/src/main/java/io/cdap/cdap/runtime/spi/provisioner/dataproc/DataprocProvisioner.java#L171
We log runtime arguments at the start of the pipeline run however if Dataproc cluster creation itself fails for some reason, additional information logged such as network name would be helpful for debugging.