delta-io/connectors

[Feature Request] Flink Connector supports Update and Delete Delta Table

YannByron opened this issue · 4 comments

Hi guys, when can Flink-Connector support Update/Delete syntax.

tdas commented

Does Flink support DELETE/UPDATE SQL syntax? From their docs it does not seem so
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/overview/

Not Flink SQL syntax.
I mean that use the new-coming data to update/merge the existing table by flink-delta-connector, not just append.
I don't know much about Flink. It may be impossible to do in current delta and flink env.

Hi @YannByron - thanks for your question. Is UPDATE/DELETE possible using the DataStream API (since you clarified that you are not referring to the SQL API)?

We are currently working on SQL and catalog support for the Flink Sink and Source.

If you could help clarify some of your requirements for UPDATE/DELETE, and what sort of API you expect, that could help us plan what we work on after. Thanks!

This repo has been deprecated and the code is moved under connectors module in https://github.com/delta-io/delta repository. Please create the issue in repository https://github.com/delta-io/delta. See #556 for details.