esq - event streaming queue
This implements the publish-subscribe pattern as a set of commands (esq-server, esq-tail, esq-write, esq-drop). A client application may directly access esq-server (esq-tail, esq-write, esq-drop are just that).
Topics are stored forever, using lmdb.
Async I/O is done through libev.
building
$ make
run server
$ ./esq-server
tail topic
$ ./esq-tail topic_a
$ ./esq-tail -n -10 topic_a (w/ last 10 events)
$ ./esq-tail -n +0 topic_a (from start)
write event
$ echo "hello" | ./esq-write topic_a
load newline-delimited data
$ ./esq-write topic_a < data.ndjson
compose
$ ./esq-tail topic_a | jq .foo | ./esq-write topic_b
drop topic
$ ./esq-drop topic_b
tests
$ make test
benchmark
$ ./esq-bench
bundled external libraries
- freebsd tailq
- libev
- lmdb
- lz4
- tinycthread
- munit for tests
TODO
- code cleanup
- client library
- esq-drop