Smaller chunks for load_targets / impute
grovduck opened this issue · 0 comments
grovduck commented
As I understand it right now, load_targets is reading in full rasters into numpy arrays. On 32-bit systems, this will likely result in MemoryError problems. Is it possible to just have load_targets store open rasterio.DatasetReader instances and do line- or block-reads from within impute?
It looks like this may be where #15 is going. If so, sorry for the redundancy.