Unable to run python3 pandas on CDAP Sandbox installed by docker
Description
Hi, I have installed CDAP sandbox from an image from Docker hub on an ubuntu 18.10 server.
However I can't run python transformation natively. I have changed nothing but python binary to /usr/bin/python3 or /usr/bin/python3.5 (the docker image is on ubuntu 16.04 with python3.5 default) or python3 or python3.5. The results are all the same, an error "Spark program 'phase-1' failed with error: loader constraint violation: loader (instance of org/apache/spark/repl/ExecutorClassLoader) previously initiated loading for a different type with name "io/cdap/plugin/common/script/ScriptContext". Please check the system logs for more details."
I have a strong feelings that I need to do something to be able to run python transformation. But I just couldn't. I haved install python3, python3.6, py4j or anything I could think of on the container.
I really need help.
Release Notes
None
Activity
Show:
Pinned fields
Click on the next to a field label to start pinning.
Hi, I have installed CDAP sandbox from an image from Docker hub on an ubuntu 18.10 server.
However I can't run python transformation natively. I have changed nothing but python binary to /usr/bin/python3 or /usr/bin/python3.5 (the docker image is on ubuntu 16.04 with python3.5 default) or python3 or python3.5. The results are all the same, an error "Spark program 'phase-1' failed with error: loader constraint violation: loader (instance of org/apache/spark/repl/ExecutorClassLoader) previously initiated loading for a different type with name "io/cdap/plugin/common/script/ScriptContext". Please check the system logs for more details."
I have a strong feelings that I need to do something to be able to run python transformation. But I just couldn't. I haved install python3, python3.6, py4j or anything I could think of on the container.
I really need help.