Udacity Data Streaming Nanodegree. Data Ingestion with Kafka

This repository contains learning materials & notes for first chapter of Udacity Data Streaming Nanodegree.

Notes

Docker & docker-compose

  • Stop & rm containers
    docker-compose stop && docker-compose rm -fsv

Using the CLI Kafka tools

  • List Kafka topics
    kafka-topics.sh --list --zookeeper localhost:2181
  • Create kafka topic
    kafka-topics.sh --create --topic "my-first-topic" --partitions 1 --replication-factor 1 --zookeeper localhost:2181
  • Run producer
    kafka-console-producer.sh --topic "my-first-topic" --broker-list localhost:9092
  • Run consumer
    kafka-console-consumer.sh --topic "my-first-topic" --bootstrap-server localhost:9092 --from-beginning