Hive ATSHook fails to execute in Secure Hadoop clusters
Description
Release Notes
Fixed CDAP to work with and publish to Yarn Timeline Server in a secure environment.
Activity
Show:
Ali Anwar August 21, 2017 at 8:56 PM
Updated to also acquire delegation tokens for Yarn TimelineServer: https://github.com/caskdata/cdap/pull/9432
Ali Anwar July 26, 2017 at 11:10 PM
With ATSHook enabled (default in Ambari 2.6+), I see the following in the explore logs:
Ali Anwar July 26, 2017 at 8:07 PMEdited
To disable the ATKHook, set the value for the following three configurations to a single space ' '.
Edit: This didn't seem to fix the issue. After we set 'yarn.timeline-service.enabled' to false, then we were able to avoid this issue in a Kerberos-enabled environment.
Fixed
Pinned fields
Click on the next to a field label to start pinning.
Created May 31, 2017 at 2:15 AM
Updated August 22, 2017 at 3:47 AM
Resolved August 22, 2017 at 3:47 AM
When we execute explore query in a secure Hadoop cluster on HDP 2.6.x, it fails with the following exception. This is because HDP 2.6.x has Hive ATSHook enabled by default, and CDAP Master does not pass the delegation token from the Timeline server to the Explore container.