A relay for carbon streams, in go. Like carbon-relay from the graphite project, except it:
- performs (much) better.
- you can adjust the routing table at runtime, in real time using the web or telnet interface.
- can be restarted without dropping packets
- supports a per-route spooling policy. (i.e. in case of an endpoint outage, we can temporarily queue the data up to disk and resume later)
This makes it easy to fanout to other tools that feed in on the metrics. Or balance load, or provide redundancy (see "first_only" config paramater), or partition the data, etc. This pattern allows alerting and event processing systems to act on the data as it is received (which is much better than repeated reading from your storage)
- support for pickle protocol, if anyone cares enough to implement it (libraries for pickle in Go already exist)
- pub-sub interface, maybe
- consistent hashing across different endpoints, if it can be implemented in an elegant way. (note that this would still be a hack and mostly aimed for legacy setups, decent storage has redundancy and distribution built in properly .
export GOPATH=/some/path/
export PATH="$PATH:$GOPATH/bin"
go get -d github.com/graphite-ng/carbon-relay-ng
go get github.com/jteeuwen/go-bindata/...
cd "$GOPATH/src/github.com/graphite-ng/carbon-relay-ng"
./make.sh
You only need the compiled binary and a config. Put them whereever you want.
carbon-relay-ng [-cpuprofile cpuprofile-file] config-file
Allows you to inspect and change routing table. (except for spooling settings). Also you can't adjust global configuration this way.
Allows you to inspect and change routing table. (except for spooling settings and remote addr). Also you can't adjust global configuration this way.
telnet <host> <port>
commands:
help show this menu
route list list routes
route add <key> [pattern] <addr> add the route. (empty pattern allows all)
route del <key> delete the matching route
route patt <key> [pattern] update pattern for given route key. (empty pattern allows all)