Unable to run python3 pandas on CDAP Sandbox installed by docker

Description

Hi, I have installed CDAP sandbox from an image from Docker hub on an ubuntu 18.10 server. 

However I can't run python transformation natively. I have changed nothing but python binary to /usr/bin/python3 or /usr/bin/python3.5 (the docker image is on ubuntu 16.04 with python3.5 default) or python3 or python3.5. The results are all the same, an error "Spark program 'phase-1' failed with error: loader constraint violation: loader (instance of org/apache/spark/repl/ExecutorClassLoader) previously initiated loading for a different type with name "io/cdap/plugin/common/script/ScriptContext". Please check the system logs for more details."

I have a strong feelings that I need to do something to be able to run python transformation. But I just couldn't. I haved install python3, python3.6, py4j or anything I could think of on the container.

I really need help.  

 

Release Notes

None

Activity

Show:
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Priority

Created October 22, 2020 at 6:29 PM
Updated October 22, 2020 at 6:29 PM