/kafka-docker-playground

Playground for Kafka/Confluent Docker experimentations

Primary LanguageShell

kafka-docker-playground Build Status

Playground for Kafka/Confluent Docker experimentations...


How to run

You just need to have docker and docker-compose

If you want to run it on EC2 Instance, you can use the AWS CloudFormation template provided here.

ℹ️ By default Confluent Platform version 5.5.0 is used, but you can test with another version (greater or equal to 5.0.0) simply by exporting TAG environment variable:

Example:

export TAG=5.3.2

Table of Contents

πŸ”— Kafka Connectors

Quick start examples from Confluent docs but in Docker version for ease of use.

β†˜οΈ Source

↗️ Sink

☁️ Confluent Cloud

  • How to connect your components to Confluent Cloud
  • How to monitor your Confluent Cloud cluster
  • How to restrict access
  • etc...

Diagram

πŸ”— Kafka Connectors connected to Confluent Cloud

Other

πŸ”„ Confluent Replicator and Mirror Maker 2

Using Multi-Data-Center setup with US πŸ‡ΊπŸ‡Έ and EUROPE πŸ‡ͺπŸ‡Ί clusters.

πŸ” Environments

Single cluster:

Multi-Data-Center setup:

  • PLAINTEXT: no security
  • SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
  • Kerberos: no SSL encryption, Kerberos GSSAPI authentication

πŸŽ“ Kafka Tutorials

This is just the excellent examples in Kafka tutorial but in Docker version for ease of use.

Confluent Commercial

Easily play with Confluent Platform Ansible playbooks by using Ubuntu based Docker images generated daily from this cp-ansible-playground repository

There is also a Confluent Cloud version available here

πŸ‘Ύ Other Playgrounds

πŸ“š Useful Resources