Docker compose environments
Docker compose environments
Install Kafka (to run the commands below)
brew install kafka
OR
sudo apt-get install kafka
Create Topic
kafka-topics --bootstrap-server localhost:9092 --topic first_topic --create --partitions 3 --replication-factor 1
Create Message in Broker
kafka-console-producer --bootstrap-server localhost:9092 --topic first_topic
Listening Message in Broker
kafka-console-consumer --bootstrap-server localhost:9092 --topic first_topic --group firsttopic
Show info of all Topics
watch kafka-consumer-groups --all-groups --bootstrap-server localhost:9092 --all-topics -describe
Show all images docker compose
docker-compose ps
Insert input command in kafka cli inside docker
docker exec -it projects_kafka_1 bash
Inside the kafka instance (docker) type the command below to see all topics
kafka-topics.sh --list --bootstrap-server localhost:29092
Describe Topic
kafka-topics.sh --create --bootstrap-server localhost:29092 --partitions 3 --replication-factor 1 --topic test-3-1
kafka-topics.sh --describe --bootstrap-server localhost:29092 --partitions 3 --replication-factor 1 --topic test-3-1
kafka-topics.sh --create --bootstrap-server localhost:29092 --partitions 3 --replication-factor 3 --topic test-3-3
kafka-topics.sh --describe --bootstrap-server localhost:29092 --partitions 3 --replication-factor 3 --topic test-3-3
Example [Describe Topic]
Kafka Cluster examples (kafka-cluster/docker-compose.yml)
Drop a kafka instance from the cluster (kafka-cluster/docker-compose.yml)
docker-compose stop kafka3