apache/doris-flink-connector

[Bug] [Source]DorisSplitRecords.finishedSplits()返回的集合有null对象导致的整个flink作业发生NullPointerException

Closed this issue · 7 comments

Search before asking

  • I had searched in the issues and found no similar issues.

Version

1.6.0

What's Wrong?

DorisSplitRecords.finishSplits()返回的集合里有且仅有一个null对象
1、第一个图里添加分片后是正常的;
2、第二个图的日志显示FetcheTask里的callBack打印出来的finishSplits里仅有一个null对象
企业微信截图_17194749296203

企业微信截图_17194741888949

What You Expected?

正常执行

How to Reproduce?

使用doris-flink-connector读取doris的表并写到另一个doris的表里

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Please post the error stack

Please post the error stack

npe.log

@JNSimba Is it possible that there was a reordering of instructions in this place? Because String is immutable, and the previous log has printed split information. And this problem happens occasionally.
image

@yingh0ng Thank you, could you please post the table schema and DorisSource configuration?

@yingh0ng Can you try this PR? It fixes the problem that the SplitId of DorisSource is repeated. #414

@yingh0ng Thank you, could you please post the table schema and DorisSource configuration?

Only have table properties of DDL:

table:
    properties:
      replication_allocation: 'tag.location.default: 1'
      enable_duplicate_without_keys_by_default: true

The DorisSource configuration:

connector=doris
fenodes=xxx
table.identifier=database.tableName
username=xxx
password=xxx
doris.request.tablet.size=10(my table`s buckets is 10)

@yingh0ng Can you try this PR? It fixes the problem that the SplitId of DorisSource is repeated. #414

Got it. Thank you!