Streaming data extensions

Question

codertao opened this issue 4 years ago · 4 comments

I'm looking to use libflate for a long running stream of data having periodic small messages (<1k), upto 30 seconds apart.

I'm still in the early stages of investigation, but I think what I need for my use case is:

a method for flushing the current block on Encoder, and (when needed), appending a zero length block to get bitwriter to the next byte boundary
a new huffman type to dynamically choose between fixed and static table, depending on which would give better block size

Is that reasonable? Am I misreading anything / have I missed existing functionality?

Would there be interest in a PR for this?

Answer 1 · 2021-03-14T08:36:43.000Z

Thank you for reaching out.
FYI, there is #28 that adds support of incremental writes to libflate. Could this PR help you?

Answer 2 · 2021-03-14T22:46:31.000Z

Aye, #28 would be half of this. Any idea why that was never merged? Looks to have been inactive for the past year and a half.

Answer 3 · 2021-03-15T00:11:18.000Z

I was busy at that time and just had forgotten the PR 😅
I think that I can merge this PR within several days.

Answer 4 · 2021-03-16T13:39:04.000Z

Merged #28 and released libflate-v1.0.4.