delta-io/connectors

[Question] How to ingest change data captured data from kafka to delta lake by Apache Flink?

ChenShuai1981 opened this issue 2 years ago · 1 comments

ChenShuai1981 commented 2 years ago

Does Delta Flink Connector support "merge into" semantics like Delta Spark DataFrame API ?

scottsand-db commented 2 years ago

Hi @ChenShuai1981. The Flink-Delta connector Sink only supports appends.

https://github.com/delta-io/connectors/tree/master/flink#can-i-use-this-connector-to-append-data-to-a-delta-table

https://github.com/delta-io/connectors/tree/master/flink#can-i-use-this-connector-with-other-modes-overwrite-upsert-etc-