...
Option 1: We drop support of RDD<StructuredRecord> and move to Dataframe<Row> with the necessary change in CDAP core.
Option 2: Add a new Engine "Spark Dataframe" and add the implementation for it.Option 3: Remove MR and current implementation of RDD<StructuredRecord> and support on DF'sit with the necessary change in CDAP core.