awslabs/mountpoint-s3

Automatically adjust prefetching based on available memory

dannycjones opened this issue · 1 comments

Tell us more about this new feature.

This issue tracks adding an automatic adjustment to the amount of prefetching based on available memory. Today, prefetching will fetch up to 3GiB per file handle which is fine for most cases but can use a lot of memory when many files are read concurrently.

Mountpoint v1.10.0 has been released with some improvements on the prefetcher.