oceanbase/flink-connector-oceanbase

[Feat.]: Split and flush buffer by partition key

whhe opened this issue · 1 comments

whhe commented

Check Before Asking

  • Please check the issue list and confirm this feature is encountered for the first time.
  • Please try full text in English and attach precise description.

Description

Split the buffer by partition key can significantly improve the writing performance.

Ref: https://github.com/alibaba/DataX/blob/master/oceanbasev10writer/src/main/java/com/alibaba/datax/plugin/writer/oceanbasev10writer/task/ConcurrentTableWriterTask.java

Other Information

No response

whhe commented

The component ob-partition-calculator is on progress of open source, this task should be started after it is available.