We're updating the issue view to help you get more done. 

Spark programs that use FileSystem fail to run on some clusters

Description

The SparkPageRank program is failing to run on some cdh versions with:

This is happening on cdh 5.3, 5.4, hdp 2.2, 2.3

Release Notes

None

Activity

Show:
Albert Shau
June 1, 2017, 8:20 PM

and now a new cluster I built with latest release/4.2 is failing with a completely different error:

Albert Shau
June 1, 2017, 8:40 PM

KeyProviderCache errors may be a red herring. I am seeing those in Mapreduce as well.

Terence Yim
June 2, 2017, 7:09 AM
Terence Yim
June 2, 2017, 7:11 AM

The root cause is due to SPARK-11818 that get fixed in 1.6

Assignee

Terence Yim

Reporter

Albert Shau

Labels

None

Docs Impact

None

UX Impact

None

Fix versions

Affects versions

Priority

Blocker
Configure