/example-pyspark-unittesting

An example of unit testing PySpark code

Primary LanguagePythonMIT LicenseMIT

Example PySpark library

Written for a post over at Dev.to. This gives an example of unit testing with PySpark when building libraries. It has been created against Databricks Runtime 7.3 which specifies the same versions of the libraries included here.