Set ssh timeout in SSHSessionManager
When we use ssh is used for monitoring, ssh connections can hang if the dataproc cluster's external IP address changes (this can happen because the IP address is ephemeral) resulting in pipelines getting stuck.
We should set a timeout on the ssh connection so that the pipeline runs fails when the cluster becomes unreachable.
Thanks, I’ll update the description.
It is not only affecting 6.1. All later versions that uses SSH has the same issue.