influxer

A demo of exactly-once processing with Flink and InfluxDB. More details in this blog post.

Usage

Startup the environment:

docker-compose up

Startup a netcat server in another terminal:

docker-compose exec netcat nc -l 9000

Build and run the Flink job:

mvn clean package -DskipTests

docker-compose exec jobmanager \
bash -c "flink run -d /influxer/target/influxer-standalone.jar 9000"

You can check the job status in the Flink UI.

Once it's running, type some numbers from the netcat server terminal:

22
24
23

Finally, check the resulting 10-second windowed sums in InfluxDB:

docker-compose exec influxdb \
influx -database data -execute 'select * from records'

Stop the environment:

docker-compose down