Introducing tox to this project

[huynguyent]

Is your feature request related to a problem? Please describe.

The goal of this project is to maintain compatibility for a wide range of dependencies, for example different versions of pyspark or deltalake. However with the current set up, the test suites only test what is in the lock file. This makes it hard to detect breaking changes, both from upstream and from this project.

Describe the solution you'd like

Use tox to test against different combination of important dependencies, such as pyspark and deltalake

Poetry seems to have tox support but I haven't tried it myself: https://python-poetry.org/docs/faq/#is-tox-supported

Describe alternatives you've considered

Maybe multiple poetry dependency groups if we won't wanna use tox

Additional context
Add any other context or screenshots about the feature request here.

Willingness to contribute

Would you be willing to contribute an implementation of this feature?

• Yes. I can contribute this feature independently.
• Yes. I would be willing to contribute this feature with guidance from the mack community.
• No. I cannot contribute this feature at this time.