silentbicycle/glean

large file indexing

Opened this issue · 0 comments

A second token table could be added for large files, with an additional value for which block(s) have the token. Using grep to search files whole is slow for very large files.

Also, what would be a good block size? 4 kb? 64 kb?