Kafka Consumer and Producer implementation.
- Starting and running kafka consumer and producer from CLI. (kafka-CLI-commands)
- Basic java implementation. (kafka-basics)
- Real time producing data from Twitter API. (kafka-producer-twitter)
- Reading the fetched data from twitter in Elasticsearch. (kafka-consumer-elasticsearch)
- Producing real time data from Twitter Source using Kafka Connect. (kafka-connect)
- Filtering tweets using Kafka Streams. (kafka-streams-filter-tweets)
I have taken detailed notes. They are a bit rusty as they were taken on go. (kafka-notes)
References -
- For Twitter dependency refer - https://github.com/twitter/hbc
- Kafka Connect Twitter jars are taken from here - https://github.com/jcustenborder/kafka-connect-twitter
- Always take the latest release.
- Docker images for Kafka environment with multiple combinations are available here. https://github.com/conduktor/kafka-stack-docker-compose