/ansible-os-kafka-deployment

Deploys an OS Kafka and Zookeeper cluster using ansible

Primary LanguageMakefile

Kafka cluster deployment

Install a Zookeeper and a Kafka cluster using ansible

Prerequisites

  • 6 Ubuntu hosts, 3 for Zookeeper, 3 for Kafka (Tested with 18.04)
  • A ssh key to connect to the hosts
  • Ansible binaries installed (Tested with 2.12.10)
apt-add-repository ppa:ansible/ansible
apt update
apt install make ansible python3-pip kafkacat

Instructions

  1. Install Azure.Azcollection inventory plugin
ansible-galaxy collection install azure.azcollection:1.11.0 && \
pip install -r ~/.ansible/collections/ansible_collections/azure/azcollection/requirements-azure.txt
  1. Set the azure credentials env vars
 export AZURE_CLIENT_ID=***
 export AZURE_SECRET=***
 export AZURE_TENANT=***
 export AZURE_SUBSCRIPTION_ID=***
  1. Check available inventory
make list-inventory
  1. Set the location of the ssh private key in env var ANSIBLE_KEY_FILE