vigna/webgraph-rs

It must be possible to load graphs into mapped memory

Closed this issue · 1 comments

vigna commented

Transparent huge pages do not work in memory-mapped files, and they can bring a significant performance increase on very large graphs.

Thus, we need three ways to load a graph:

  • mmap()'d file (with flags)
  • heap-allocated memory
  • mmap()-allocated memory (with flags)

This is identical to the possibilities we have in ε-serde with MemCase.

vigna commented

Solved by new load system.