JHS execute blocks can cause Mapreduce to fail

Description

Guards are honored in Chef when a wrapper uses .run_action on a resource. For execute blocks, this can prevent otherwise idempotent blocks from executing correctly.

For example:

  • Execute mapreduce-jobhistory-done-dir creates /tmp/hadoop-yarn/staging/history/done

  • Execute yarn-app-mapreduce-am-staging-dir creates /tmp/hadoop-yarn/staging, but only if it doesn't exist

In this case, the yarn.app.mapreduce.am.staging-dir doesn't get its proper permissions set.

Release Notes

None

Activity

Show:
Chris Gianelloni
April 4, 2015, 10:03 PM
Chris Gianelloni
April 4, 2015, 11:15 PM

This has been merged to master of hadoop_cookbook

Fixed

Assignee

Chris Gianelloni

Reporter

Chris Gianelloni

Labels

None

Docs Impact

None

UX Impact

None

Components

Priority

Major
Configure