delta-io/connectors

[FEATURE REQUEST] Generate multiple Delta tables from single Flink sink

Xoerk opened this issue · 2 comments

Xoerk commented

I'm trying to find a way to generate multiple Delta/Databricks tables when connecting to the Flink stream, from looking at the documentation of Flink connection, the Flink connecter takes the path location in the constructer which defines a single table in Delta/Databricks.

Will it be possible to dynamically define the tables based on the data stream?

Hi @Xoerk, thanks for your question. Can you tell us a bit more about your use cases here? And give an example of what you'd like to see by dynamically defin[ing] the tables based on the data stream

Also, do you want to write the same, identical output to multiple output tables?