Error while running %AddDeps to add vegas to apache toree scala kernel
asdspal opened this issue · 1 comments
asdspal commented
I'm just starting with your project. I'm getting error while adding vegas as a dependency in apache-toree scala kernel.
Spark-version -- 2.2.0 (scala -version 2.11.8)
apache-toree -- 0.2.0-dev1
vegas-version -- 0.3.11
error message
error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/reflect/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Serializable, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Serializable.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
res4: Either[org.apache.toree.magic.CellMagicOutput,org.apache.toree.magic.LineMagicOutput] = Right(())
error: error while loading Predef, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Predef.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
MeanWhile, nice project. I have been planning to shift to scala for spark, but was stuck with pyspark in absence of nice visualization library for scala.
asdspal commented
Solved it. It was due to conflict between scala-reflect-2.11.6
and scala-reflect-2.11.8
. I had to manually install vegas-viz and its dependencies to local maven repo. Then added vegas-viz
as sparks.jars.pacakages
in configuration file instead of loading it on the run.