what are the current project perquisites for building and installing Deequ locally?
jasonhorner opened this issue · 0 comments
Based on this page in the documentation:
https://github.com/awslabs/deequ#requirements-and-installation
it still shows there is still a dependency on JDK 1.8 and spark 3.1.
I believe this information is out of date for the current release (https://github.com/awslabs/deequ/releases/tag/2.0.3)
based on this changelog:
https://github.com/awslabs/deequ/releases/tag/2.0.2
it looks like the current release supports spark 3.3 (and likely 3.2)
I'm happy to submit a documentation PR but want to verify that as of the latest release there is support for spark 3.3 and 3.2
and the correct version of the JDK is 11?
I would also like to submit a PR with more detailed build instructions.
for my windows environment, I had to install both maven and make (I get this is likely an edge case but having some documentation around the build process may encourage more people to submit pr's)
A lot of this is pretty basic knowledge for someone familiar with this stack / project. As someone newer to this, I'm just looking for ways to help.