We're updating the issue view to help you get more done. 

Remove all usages to BatchContext.getHadoopJob()

Description

Currently there are plugins that get the Hadoop Job object and use it to set properties. This makes plugins not reusable when switching the execution engine to Spark. We should use InputFormatPvoider / OutputFormatProvider instead.

The getHadoopJob() method is already deprecated.

Release Notes

None

Activity

Show:
Terence Yim
November 10, 2015, 1:46 AM

Fixed plugins inside cdap repo: https://github.com/caskdata/cdap/pull/4512

Still need to fix those in the hydrator plugins repo.

Terence Yim
April 25, 2016, 4:09 AM

Fix in https://github.com/caskdata/hydrator-plugins/pull/241

Need to verify Hive in secure mode to see if it still works.

We may need to introduce new method to the data pipeline API to allow plugin adding new delegation tokens for the execution.

Assignee

Terence Yim

Reporter

Terence Yim

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Priority

Blocker
Configure