Using Debezium From Oracle To Oracle

You must download the Oracle instant client for Linux and put it under the directory debezium-with-oracle-jdbc/oracle_instantclient.

                   +-------------+
                   |             |
                   |   Oracle    |
                   |             |
                   +-------------+
                          +
                          |
                          |
                          |
                          v
          +----------------------------------+
          |                                  |
          |           Kafka Connect          |
          |  (Debezium, JDBC connectors)     |
          |                                  |
          +----------------------------------+
                          +
                          |
                          |
                          |
                          v
                 +-----------------+
                 |                 |
                 |  TARGET ORACLE  |
                 |                 |
                 +-----------------+

Start the topology as defined in https://debezium.io/docs/tutorial/

export DEBEZIUM_VERSION=1.6
docker-compose -f docker-compose.yaml up --build

Start Oracle sink connector for Customers table.

curl -i -X POST -H "Accept:application/json" -H  "Content-Type:application/json" http://localhost:8083/connectors/ -d @register-oracle-sink-customers.json

Start Oracle source connector

curl -i -X POST -H "Accept:application/json" -H  "Content-Type:application/json" http://localhost:8083/connectors/ -d @register-source-oracle.json

Connect to Source Oracle DB
- Host: localhost
- Port: 1521
- Service Name: XE
- user: SYS
- pass: oracle
Connect to Target Oracle DB
- Host: localhost
- Port: 3042
- Service Name: XE
- user: SYS
- pass: oracle
Make changes on Source DB, see results on kafka topic, and on the target database.

--SOURCE DB
SELECT * FROM INVENTORY.CUSTOMERS c ;

UPDATE INVENTORY.CUSTOMERS c SET c.FIRST_NAME = CASE WHEN c.FIRST_NAME = 'Anne' THEN 'Marie Anne' ELSE 'Anne' END 
WHERE c.id = 1004;

UPDATE INVENTORY.CUSTOMERS c SET c.EMAIL = c.EMAIL || '.tr';

--TARGET DB

SELECT * FROM ALL_TABLES at2 WHERE OWNER = 'INVENTORY';

SELECT * FROM INVENTORY.CUSTOMERS c;

See the kafka topics

docker exec -it kafka /kafka/bin/kafka-topics.sh --bootstrap-server kafka:9092 --list

Inpsect a kafka topic

export DEBEZIUM_VERSION=1.6
docker-compose -f docker-compose.yaml exec kafka /kafka/bin/kafka-console-consumer.sh \
    --bootstrap-server kafka:9092 \
    --from-beginning \
    --property print.key=true \
    --topic dbz_oracle.INVENTORY.CUSTOMERS

See the connectors

curl -i -X GET  http://localhost:8083/connectors

See the source and sink Status on grafana

Manage Connectors

See the connector status

curl -s "http://localhost:8083/connectors?expand=info&expand=status"

 curl -s "http://localhost:8083/connectors?expand=info&expand=status" | \
   jq '. | to_entries[] | [ .value.info.type, .key, .value.status.connector.state,.value.status.tasks[].state,.value.info.config."connector.class"]|join(":|:")' | \
   column -s : -t| sed 's/\"//g'| sort

Restart a connector

curl -i -X POST  http://localhost:8083/connectors/inventory-source-connector/restart
#OR 
curl -i -X POST  http://localhost:8083/connectors/jdbc-sink-customers/restart

Remove a connector

curl -i -X DELETE  http://localhost:8083/connectors/inventory-source-connector
#OR 
curl -i -X DELETE  http://localhost:8083/connectors/jdbc-sink-customers

Stop the topology

export DEBEZIUM_VERSION=1.6
docker-compose -f docker-compose.yaml down

burhanorkun/debezium_w_ora

Using Debezium From Oracle To Oracle