/SparkTemplate

A simple Java-Scala mixed project template for Apache Spark

Primary LanguageScala

SparkTemplate

A simple Java-Scala mixed project template for Apache Spark

alt text

You can simply download and import this project in your IDE (preferably in IntelliJ IDEA), then edit your code and export your executable jar file.

Make sure you have installed Scala plugin and sbt in your IDE!

The settings in sbt.build file are fine to export an executable jar file for Amazon EMR 5.29.0

You can export the project in IntelliJ IDEA as follows:

"View" > "Tool window" > "sbt" > "SparkTemplate" > "SparkTemplate (root)" > "sbt tasks" > "assembly"

Your jar file will be located in target/scala-2.x