Details

    • Type: Bug
    • Status: IN DEVELOPMENT
    • Priority: Blocker
    • Resolution: Unresolved
    • Affects versions: None
    • Fix versions: 6.1.5, 6.2.4
    • Components: None
    • Labels:
      None
    • Sprint:

      Description

      Pipelines without serviceAccountType is failing with npe for google cloud plugins. There were changes made in PLUGIN-170 which has caused this backwards incompatibility. This may be happening for multiple plugins but this was tested for bigquery source. 

      Attached is the sample pipeline. Below is the failure message.

      2020-10-26 22:28:25,370 - ERROR [appfabric-executor-69:i.c.c.g.h.AppLifecycleHttpHandler$2@640] - Deploy failure
      java.lang.IllegalArgumentException: Failed to configure pipeline: Stage 'BigQuery2' encountered : Null error occurred while configuring the stage.
      	at io.cdap.cdap.datapipeline.SmartWorkflow.configure(SmartWorkflow.java:178) ~[na:na]
      	at io.cdap.cdap.api.workflow.AbstractWorkflow.configure(AbstractWorkflow.java:58) ~[na:na]
      	at io.cdap.cdap.app.DefaultAppConfigurer.addWorkflow(DefaultAppConfigurer.java:174) ~[na:na]
      	at io.cdap.cdap.api.app.AbstractApplication.addWorkflow(AbstractApplication.java:118) ~[na:na]
      	at io.cdap.cdap.datapipeline.DataPipelineApp.configure(DataPipelineApp.java:68) ~[na:na]
      	at io.cdap.cdap.api.app.AbstractApplication.configure(AbstractApplication.java:59) ~[na:na]
      	at io.cdap.cdap.internal.app.deploy.InMemoryConfigurator.createResponse(InMemoryConfigurator.java:156) ~[na:na]
      	at io.cdap.cdap.internal.app.deploy.InMemoryConfigurator.config(InMemoryConfigurator.java:117) ~[na:na]
      	at io.cdap.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:113) ~[na:na]
      	at io.cdap.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:58) ~[na:na]
      	at io.cdap.cdap.pipeline.AbstractStage.process(AbstractStage.java:53) ~[na:na]
      	...
             ...
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_181]
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_181]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_181]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_181]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_181]
      Caused by: io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. Null error occurred while configuring the stage.
      	at io.cdap.cdap.etl.validation.DefaultFailureCollector.getOrThrowException(DefaultFailureCollector.java:77) ~[na:na]
      	at io.cdap.cdap.etl.spec.PipelineSpecGenerator.configureStage(PipelineSpecGenerator.java:336) ~[na:na]
      	at io.cdap.cdap.etl.spec.PipelineSpecGenerator.configureStage(PipelineSpecGenerator.java:218) ~[na:na]
      	at io.cdap.cdap.etl.spec.PipelineSpecGenerator.configureStages(PipelineSpecGenerator.java:166) ~[na:na]
      	at io.cdap.cdap.etl.batch.BatchPipelineSpecGenerator.generateSpec(BatchPipelineSpecGenerator.java:57) ~[na:na]
      	at io.cdap.cdap.datapipeline.SmartWorkflow.configure(SmartWorkflow.java:175) ~[na:na]
      	... 32 common frames omitted 

        Attachments

          Issue links

            Activity

              People

              • Assignee:
                Bajram Bojku
                Reporter:
                Vinisha Shah
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated: