/debezium-docker-example

📤 A Docker Compose stack based on Debezium to create a CDC infrastructure

Primary LanguageShell

Project logo

Debezium Docker Example

Status Status GitHub Issues GitHub Pull Requests

📤 A Docker Compose stack based on Debezium to create a CDC infrastructure

📝 Table of Contents

🧐 About

A docker compose stack to create a CDC (Change Data Capture) infrastructure. Is based on Debezium plugin, replicating a Postgres base to Elasticsearch server.

💭 How it works

Project Diagram

🎈 Usage

Some useful links to query the data processing:

Kibana

http://localhost:5601

PgAdmin

http://localhost:16543

Elastic Data

http://localhost:9200/musics/_search?pretty=true

Connectors

http://localhost:8083/connectors

Connectors Status

http://localhost:8083/connectors?expand=status

Connectors Info

http://localhost:8083/connectors?expand=info

🏁 Getting Started

Just clone and execute this steps:

Initialize Docker

docker-compose up --detach --build --force-recreate

Crete ElasticSearch Index and Apache Kafka Conectors

sh setup.sh

Prerequisites

Docker Compose 1.29.2
Docker 20.10.10

⛏️ Built Using

  • Debezium - Open source distributed platform for change data capture.
  • Apache Kafka - Open source distributed event streaming platform.
  • Apache ZooKeeper - Centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.
  • ElasticSearch - A search engine based on the Apache Lucene library. It provides a distributed, multitenant-capable full-text search engine with an HTTP web interface and schema-free JSON documents.
  • PostgreSQL - Open source object-relational database system.

✍️ Authors