/delimitedbuffer

A library for reading and writing streams of delimited binary data (blobs)

Primary LanguageGoMIT LicenseMIT

delimitedbuffer

A library to read and write streams of delimited blobs, as described in: https://developers.google.com/protocol-buffers/docs/techniques#streaming Can be used for protocol buffer binaries, or any other data. Blobs are preceeded by their 4-byte size (max 4294967295 bytes)

Embeds bytes.Buffer and implements the common interfaces to support chained readers/writers to handle one full datum at a time.

Ideas/Future plans

  • Option to write a header before every datum
    • Checksum for the datum
    • Content encoding (gzip etc)
    • Byte-size of the datum to follow contained in header