aws-kafka-docker

system infranstructure

Instances Dashboard

Kafka configuration

  • create topic: kafka-topics.bat --create --topic test-5 -zookeeper 54.160.126.51:2181 --replication-factor 3 --partitions 3
  • kafka-broker-1
  • sudo nano kafka/config/server.properties

    • broker.id=0
    • listeners=PLAINTEXT://172.31.50.25:9092
    • auto.create.topics.enable=false
    • log.dirs=/tmp/kafka-logs-0
    • zookeeper.connect=172.31.56.216:2181
  • kafka-broker-2
  • sudo nano kafka/config/server.properties

    • broker.id=1
    • listeners=PLAINTEXT://172.31.34.94:9092
    • auto.create.topics.enable=false
    • log.dirs=/tmp/kafka-logs-1
    • zookeeper.connect=172.31.56.216:2181
  • kafka-broker-3
  • sudo nano kafka/config/server.properties

    • broker.id=2
    • listeners=PLAINTEXT://172.31.45.235:9092
    • auto.create.topics.enable=false
    • log.dirs=/tmp/kafka-logs-2
    • zookeeper.connect=172.31.56.216:2181

Docekr Run Command

docker run -d -e "spring.profiles.active=prod" -e "spring.cloud.config.uri=http://172.31.95.239:8012" -e "spring.rabbitmq.host=INTERNAL-CONTAINER-IP OR INSTANCE-IP" --network host DOCKERHUBNAME/IMAGE_NAME