Update Deequ to Spark 3.4

Question

jklap opened this issue 2 years ago · 2 comments

We are currently using Databricks w/Deequ using an older Databricks runtime that has Spark 3.3.0 in it.

Unfortunately we need to update to a more recent Databricks runtime due some feature updates -- but that means we are moving to Spark 3.4.0.

Please consider this a request to update Deequ to support Spark 3.4.0

Answer 1 · 2023-09-28T20:17:03.000Z

Merged PR #505 to add Spark 3.4.0 support

Answer 2 · 2023-10-12T01:44:29.000Z

Could we release this to Maven?