vegas-viz/Vegas

Error while running %AddDeps to add vegas to apache toree scala kernel

asdspal opened this issue · 1 comments

I'm just starting with your project. I'm getting error while adding vegas as a dependency in apache-toree scala kernel.

Spark-version -- 2.2.0 (scala -version 2.11.8)
apache-toree -- 0.2.0-dev1
vegas-version -- 0.3.11

error message

 error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/reflect/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading package, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/package.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
error: error while loading Serializable, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Serializable.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)
res4: Either[org.apache.toree.magic.CellMagicOutput,org.apache.toree.magic.LineMagicOutput] = Right(())
error: error while loading Predef, class file '/home/pauli/wspace/SoftLib/spark-2.2.0/jars/scala-library-2.11.8.jar(scala/Predef.class)' is broken
(class java.lang.RuntimeException/Scala class file does not contain Scala annotation)

MeanWhile, nice project. I have been planning to shift to scala for spark, but was stuck with pyspark in absence of nice visualization library for scala.

Solved it. It was due to conflict between scala-reflect-2.11.6 and scala-reflect-2.11.8. I had to manually install vegas-viz and its dependencies to local maven repo. Then added vegas-viz as sparks.jars.pacakages in configuration file instead of loading it on the run.