memmap support
Opened this issue · 1 comments
j6k4m8 commented
jque("path/to/data.json", memmap=True)Should leave the data on disk and lazy-load as needed to save on RAM usage.
Only works with filepath load option.
j6k4m8 commented
I thiiiiiink I want to replace this with dask dataframe support, and offload the swappery to dask. This also gets parallelism for free, which is cute...