Incomplete HIVE_CLASSPATH in EMR 5.2 clusters

Description

In EMR 5.2, Hive engine is Tez and hence Hive classpath contains Tez jars. However the HIVE_CLASSPATH determined by CDAP does not contain the Tez jars, and hence queries fail.

Release Notes

Include Tez JARs in HIVE_CLASSPATH on Amazon EMR clusters with Tez installed.

blocks

relates to

Activity

Show:

Chris GianelloniMay 23, 2017 at 5:46 PM

OK. Just realized that we bypass the normal CDAP detection on EMR.

Here's a PR: https://github.com/caskdata/cdap/pull/8871

Chris GianelloniMay 8, 2017 at 2:34 PM

We currently use the CLASSPATH from the "hive" command. Perhaps the Hive metastore is using a different CLASSPATH from the hive client?

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Affects versions

Components

Fix versions

Priority

Created May 5, 2017 at 10:37 PM
Updated May 30, 2017 at 11:43 PM
Resolved May 25, 2017 at 5:48 PM