kawadia/pyspark.test

Example unit tests for Apache Spark Python scripts using the py.test framework

Examples py.test unit tests for PySpark

See this blog post for more details:

Unit testing Apache Spark with py.test

https://engblog.nextdoor.com/unit-testing-apache-spark-with-py-test-3b8970dc013b