awslabs/deequ

what are the current project perquisites for building and installing Deequ locally?

jasonhorner opened this issue · 0 comments

Based on this page in the documentation:
https://github.com/awslabs/deequ#requirements-and-installation

it still shows there is still a dependency on JDK 1.8 and spark 3.1.

I believe this information is out of date for the current release (https://github.com/awslabs/deequ/releases/tag/2.0.3)

based on this changelog:
https://github.com/awslabs/deequ/releases/tag/2.0.2

it looks like the current release supports spark 3.3 (and likely 3.2)

I'm happy to submit a documentation PR but want to verify that as of the latest release there is support for spark 3.3 and 3.2
and the correct version of the JDK is 11?

I would also like to submit a PR with more detailed build instructions.
for my windows environment, I had to install both maven and make (I get this is likely an edge case but having some documentation around the build process may encourage more people to submit pr's)

A lot of this is pretty basic knowledge for someone familiar with this stack / project. As someone newer to this, I'm just looking for ways to help.