niftimus/SparkMMS

Spark Compatabilities

Opened this issue · 1 comments

Hey has this been tested with Spark 3.2 and DBR 10?

The unit tests are executed using Apache Spark 3.1.2 which seems to be packaged with DBR 9.1 LTS per https://docs.databricks.com/release-notes/runtime/releases.html. The tests have not been run so far against earlier / later Spark versions. Mileage may therefore vary on the later Spark release.