We're updating the issue view to help you get more done. 

Projection Transform - If a particular field's data, which is being converted, is null, the projection transform fails

Description

For example, say a field content_length which is int and we want to convert it to long. And say the incoming data is null, Projection Transform doesn't handle it and throws a NPE.

Release Notes

None

Activity

Show:
Gokul Gunasekaran
June 8, 2015, 11:28 PM

Stack Trace:

2015-06-08 23:22:26,850 - ERROR [main:?@?] - Exception thrown in BatchDriver Mapper : {} java.lang.NullPointerException: null at co.cask.cdap.template.etl.transform.ProjectionTransform.convertPrimitive(ProjectionTransform.java:239) ~[na:na] at co.cask.cdap.template.etl.transform.ProjectionTransform.convertAndSet(ProjectionTransform.java:192) ~[na:na] at co.cask.cdap.template.etl.transform.ProjectionTransform.transform(ProjectionTransform.java:166) ~[na:na] at co.cask.cdap.template.etl.transform.ProjectionTransform.transform(ProjectionTransform.java:49) ~[na:na] at co.cask.cdap.template.etl.common.TrackedTransform.transform(TrackedTransform.java:42) ~[cdap-etl-core-3.0.1.jar:na] at co.cask.cdap.template.etl.common.TransformExecutor.runOneIteration(TransformExecutor.java:71) ~[cdap-etl-core-3.0.1.jar:na] at co.cask.cdap.template.etl.batch.ETLMapReduce$ETLMapper.map(ETLMapReduce.java:205) ~[1433805732178-0/:na] at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) [hadoop-mapreduce-client-core-2.4.0.2.1.7.0-784.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapperWrapper.run(MapperWrapper.java:109) [co.cask.cdap.cdap-app-fabric-3.0.1.jar:na] at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) [hadoop-mapreduce-client-core-2.4.0.2.1.7.0-784.jar:na] at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) [hadoop-mapreduce-client-core-2.4.0.2.1.7.0-784.jar:na] at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) [hadoop-mapreduce-client-app-2.4.0.2.1.7.0-784.jar:na] at java.security.AccessController.doPrivileged(Native Method) [na:1.7.0_75] at javax.security.auth.Subject.doAs(Subject.java:415) [na:1.7.0_75] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594) [hadoop-common-2.4.0.2.1.7.0-784.jar:na] at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) [hadoop-mapreduce-client-app-2.4.0.2.1.7.0-784.jar:na]
2015-06-08 23:22:58,161 - ERROR [MapReduceRunner-ETLMapReduce:c.c.c.i.a.r.ProgramControllerServiceAdapter$1@73] - Program terminated with exception java.lang.IllegalStateException: MapReduce execution failure: job-id : job_1433793868088_0060uber-mode : falsemap-progress : 1.0reduce-progress : 0.0cleanup-progress : 1.0setup-progress : 1.0runstate : FAILEDstart-time : 1433805642838user-name : yarnpriority : NORMALscheduling-info : NAnum-used-slots0num-reserved-slots0used-mem0reserved-mem0needed-mem0 at com.google.common.base.Preconditions.checkState(Preconditions.java:176) ~[com.google.guava.guava-13.0.1.jar:na] at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.run(MapReduceRuntimeService.java:339) ~[co.cask.cdap.cdap-app-fabric-3.0.1.jar:na] at

Fixed

Assignee

Albert Shau

Reporter

Gokul Gunasekaran

Labels

None

Docs Impact

None

UX Impact

None

Fix versions

Affects versions

Priority

Major
Configure