Hydrator error not clear - java.lang.IllegalStateException
Description
Release Notes
None
Activity
Show:
Bhooshan Mogal May 9, 2019 at 5:35 PM
Usually in such scenarios, there should be an actual error before this. Closing this for now.
Ali Anwar September 20, 2016 at 7:59 PM
There should've been more useful error messages higher up, above the errors you pasted. Are there not?
Won't Fix
Pinned fields
Click on the next to a field label to start pinning.
Details
Details
Assignee
Albert Shau
Albert ShauReporter
Dave Finnegan
Dave FinneganAffects versions
Components
Priority
Created September 20, 2016 at 7:55 PM
Updated July 17, 2020 at 12:27 AM
Resolved May 9, 2019 at 5:35 PM
Using a Stream source with a misconfigured format (text instead of csv), with parsed output schema, the pipeline fails with an error of:
java.lang.IllegalStateException: MapReduce execution failure: job-id : job_local2048395063_0003uber-mode : falsemap-progress : 0.0reduce-progress : 0.0cleanup-progress : 1.0setup-progress : 1.0runstate : FAILEDstart-time : 0user-name : sepidehayanipriority : NORMALscheduling-info : NAnum-used-slots0num-reserved-slots0used-mem0reserved-mem0needed-mem0
at com.google.common.base.Preconditions.checkState(Preconditions.java:176) ~[com.google.guava.guava-13.0.1.jar:na]
at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.run(MapReduceRuntimeService.java:363) ~[co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:52) ~[com.google.guava.guava-13.0.1.jar:na]
at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService$1$1.run(MapReduceRuntimeService.java:422) [co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]
This was a simple case of failing to specify csv to parse the input from the stream and ending up with a message that was difficult to diagnose.
If possible, it would be better if the error would indicate that the output schema did not match the input and format spec some how.