/spark-testing

Primary LanguageJavaApache License 2.0Apache-2.0

Spark Testing

Build Status Coverage Status

Project to learn how to effectively develop and test Spark applications.

Building

This is a Maven based project. Simply run mvn clean install

Running

There are a few options here:

  • Run it from the unit test (which is the goal of this project)
  • Run on Spark with the spark-submit.sh script (see Spark documentation for that)
  • Run the Main.main() method from your IDE or java command line