esq - event streaming queue

This implements the publish-subscribe pattern as a set of commands (esq-server, esq-tail, esq-write, esq-drop). A client application may directly access esq-server (esq-tail, esq-write, esq-drop are just that).

Topics are stored forever, using lmdb.

Async I/O is done through libev.

building

$ make

run server

$ ./esq-server

tail topic

$ ./esq-tail topic_a

$ ./esq-tail -n -10 topic_a (w/ last 10 events)

$ ./esq-tail -n +0 topic_a (from start)

write event

$ echo "hello" | ./esq-write topic_a

load newline-delimited data

$ ./esq-write topic_a < data.ndjson

compose

$ ./esq-tail topic_a | jq .foo | ./esq-write topic_b

drop topic

$ ./esq-drop topic_b

tests

$ make test

benchmark

$ ./esq-bench

bundled external libraries

• freebsd tailq
• libev
• lmdb
• lz4
• tinycthread
• munit for tests

TODO

• code cleanup
• client library
• esq-drop