[Feature][processor]Add processor type

Question

[Feature][processor]Add processor type

ChenpiDog opened this issue 2 years ago · 4 comments

Dataplane can consider adding SQL and HTTP processor types, especially SQL, which is quite common in ETL.

Answer 1 · 2022-10-15T02:38:16.000Z

Dataplane can provide a data source management (#447 is built on it), manage and reuse various data connections, such as MySQL, GreenPlum, etc. When using SQL processor, you can select data connection.

Answer 2 · 2022-10-15T03:11:42.000Z

For ETL related processors, lineage data kinship should be considered. #445

Answer 3 · 2022-10-15T03:17:34.000Z

HTTP processor is mainly used for serverless functions (such as OpenFaaS), which is also related to data processing.

Answer 4 · 2022-10-15T09:08:21.000Z

Move to Discussion #449