The BV graph compressor should save offsets

Question

The BV graph compressor should save offsets

vigna opened this issue a year ago · 5 comments

Answer 1 · 2023-12-30T21:46:32.000Z

@zommiommy is this already happening?

Answer 2 · 2024-01-01T20:46:06.000Z

I've implemented it only for sequential compression. The parallel one is yet to be implemented. What's the best approach? Should we create several bitstreams and merge them like we do with the graph or is there a better way?

Answer 3 · 2024-01-01T21:02:14.000Z

Yes, it's the same. Since it's a cumulative stored by deltas, the important thing is that when concatenating you strip the first zero from every batch except the first.

Answer 4 · 2024-01-28T14:06:07.000Z

In fact, the responsibility of writing the offsets should be delegated to the Encoder in the current architecture.