laminarmq-io

An attempt to rewrite laminarmq I/O layer to accommodate capped/bounded memory overhead, both when reading and writing.

Usage

laminarmq-io is a library crate. In order to use it, add the following to your Cargo.toml

[dependencies]
laminarmq-io = { git = "https://github.com/arindas/laminarmq-io.git" }

Overview

This crate provides the following traits:

AsyncRead
AsyncBufRead
StreamRead
AsyncAppend
AsyncTruncate
StreamAppend
AsyncRemove
AsyncClose

On top of these traits, we aim to provide the following abstractions:

Streaming read / append
Buffered Reader
Buffered Appender
Direct Reader and Buffered Appender
Buffered Reader and Direct Appender
Buffered Reader and Buffered Appender
Streaming Reader and Buffered Appender

This library acknowledges the fact that even simply reading may require mutation (such as advancing the filepointer) on different platforms. Hence all operations are exclusive. This library aims to remove the need for unnecessary internal locks in our I/O abstractions.

This generality allows us to abstract over local file system based storage as well as object storage (like AWS S3) with the same API.

License

This repository is licensed under the same terms as laminarmq. See LICENSE for more details.