thunchanokbow/Cinema-Data-Streaming-with-Kafka

change data capture (CDC) to ingest binlogs from the source database, process them, and write them to the target database correctly, completely, and instantly in real time. using docker-compose,Kafka connectors (debezium, jdbc sink), compute engine, cloud sql, database mysql, confluent.

Cinema Data Streaming with Kafka

Build a data synchronization system between databases with Kafka that implements change data capture (CDC) to ingest binlogs from the source database, process them, and write them to the target database correctly, completely, and instantly in real time.

Project Overview

Contents

Cloud SQL for MySQL database.

• Hosting MySQL on Cloud SQL.
  
• Connect via DBeaver.
  

Compute Engine.

• Create VM Instances.
  
• Install Git and Docker on a new VM.
  
• Upload YAML files to VM .
  
• Get Confluent Control Center.
  

Connect Debezium connector to Cloud SQL for MySQL.
Connect JDBC sink connector to CloudSQL for MySQL.

• How to fix error message "No suitable driver found"