We're updating the issue view to help you get more done. 

Make Hydrator batch actions formal plugins

Description

Batch Hydrator pipelines support adding an email custom action that runs at the end of the workflow. Actions should be implemented as plugins.

In addition, they should probably not be implemented as custom actions, but should run in the onFinish() method of the mapreduce/spark job. The reason is that many of these actions should occur when the mapreduce fails. A very common use case is to send an email when the pipeline errors for some reason. If they are workflow custom actions, they will only be run if the mapreduce finishes successfully.

Release Notes

Added a 'postaction' Hydrator plugin type that runs at the end of a pipeline run, whether the run succeeded or failed.

Activity

Show:
Albert Shau
April 11, 2016, 10:50 PM

Assignee

Albert Shau

Reporter

Albert Shau

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Priority

Major
Configure