MrPowers/mack

Function to get the latest version of a Delta table

Closed this issue · 3 comments

Delta tables can have multiple versions. v0, v1, v2, etc.

The Jodie library has a latest_version function that returns the latest version of the Delta table: https://github.com/MrPowers/jodie#latest-version-of-delta-table

We should add a mack.latest_version function to access the same functionality in PySpark.

@MrPowers you mind if I take this one?

@danielbeach - sure thing, just assigned it to you.

@MrPowers I pushed up a PR, happy to make changes to make the code "fit" in this repo more, still trying to learn the style you all have going on here. Thanks.