Realtime pipeline fails to run
The Pubsub cloud integration test is failing because the pipeline fails to start. The pipeline gets stuck in the starting state. When I SSH to the dataproc master node, I see the following in the program.log for the run:
This error never makes it to the CDAP logs. In addition, the remote process is stuck forever shutting down. Taking a stack dump, I see a single thread:
which looks related.
Also attached the pipeline generated by the integration test (with project id redacted)