π Explore the power of stream processing with Debezium Avro Integration! This project showcases the seamless integration between Debezium, an open-source distributed platform for change data capture (CDC), and Avro, a compact, fast, binary data format.
Debezium Avro Integration demonstrates how to leverage Debezium for capturing changes in your databases in real-time and serializing the data using Avro format, which is not only compact but also supports schema evolution. By integrating with a schema registry, the project ensures that the schemas are consistently managed and compatible across different versions, enhancing data integrity and reliability in streaming architectures.
This section provides instructions on configuring Debezium to capture data changes from various sources and stream them to Kafka using Avro serialization. It's a foundational step for setting up real-time data pipelines that are robust, scalable, and maintainable.
We have different examples which you can find in the examples directory. These include:
- Avro Integration Example: Demonstrates using Avro as a serialization method.
- MongoDB Sink Example: Shows how to use MongoDB as a sink, with MySQL as the source.
We welcome contributions to this repository! If youβre interested in contributing, please take a look at our CONTIRIBUTION.md file for more information on how to get started. We look forward to collaborating with you!
This repository is licensed under the MIT License, which is a permissive open-source license that allows for reuse and modification of the code with few restrictions. You can find the full text of the license in this file.