Use dask checkpoint function in dask executor
rabernat opened this issue · 0 comments
rabernat commented
Dask recently released some advanced graph manipulation tools, which includes a checkpoint
function.
We could use this instead of our low-level hack to make a checkpoint here:
rechunker/rechunker/executors/dask.py
Lines 51 to 53 in 6cc0f26