[Bug]: Periodic snapshots expiring tasks will be scheduled redundantly
Closed this issue · 1 comments
wangtaohz commented
What happened?
There are 3 threads simultaneously performing snapshot expiring on the same table.
2023-12-19 17:29:38,325 INFO [ASYNC-SnapshotsExpiringExecutor-0] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files
2023-12-19 17:29:38,406 INFO [ASYNC-SnapshotsExpiringExecutor-3] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files
2023-12-19 17:29:39,233 INFO [ASYNC-SnapshotsExpiringExecutor-4] [com.netease.arctic.server.optimizing.maintainer.MixedTableMaintainer] [] - hdfs://xxxx/yyyy/zzzz/change delete 384 ch
ange files
Affects Versions
master
What engines are you seeing the problem on?
No response
How to reproduce
Update the table properties.
Relevant log output
No response
Anything else
I believe other executors like DataExpiringExecutor OrphanFilesCleaningExecutor have the same problem.
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
HuangFru commented
I reproduced the issue and I will submit a PR to fix it later.