We're updating the issue view to help you get more done. 

Remove the use of useDatasets in MR, Worker configure methods

Description

Currently the users need to use useDatasets in the configure phase to mention all the datasets that they will be using in the Worker/MR. This is not required anymore and thus these methods need to be deprecated.

Release Notes

None

Activity

Show:
Gokul Gunasekaran
March 18, 2015, 4:01 AM
Andreas Neumann
March 18, 2015, 11:02 PM

Can we do this for all program types? Flows. Spark, Handlers, whatnot.

Gokul Gunasekaran
March 20, 2015, 12:43 AM

Yes we should. I will open a JIRA for that. Basically one should be able get and use datasets in runtime without specifying it during compile time. Right?

Andreas Neumann
March 20, 2015, 12:57 AM

Right. But it will require code changes for Flows, definitely. I also am not sure about Mappers/Reducers. I know in the beforeSubmit() and onFinish() we can now dynamically instantiate, but the Mappers/Reducers might still rely on what was declared with useDataset().

Assignee

Gokul Gunasekaran

Reporter

Gokul Gunasekaran

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Priority

Major
Configure