influxer
A demo of exactly-once processing with Flink and InfluxDB. More details in this blog post.
Usage
Startup the environment:
docker-compose up
Startup a netcat server in another terminal:
docker-compose exec netcat nc -l 9000
Build and run the Flink job:
mvn clean package -DskipTests
docker-compose exec jobmanager \
bash -c "flink run -d /influxer/target/influxer-standalone.jar 9000"
You can check the job status in the Flink UI.
Once it's running, type some numbers from the netcat server terminal:
22
24
23
Finally, check the resulting 10-second windowed sums in InfluxDB:
docker-compose exec influxdb \
influx -database data -execute 'select * from records'
Stop the environment:
docker-compose down