[Improvement]: Configure `iceberg.worker.num-threads` in the configuration file
Closed this issue · 1 comments
zhongqishang commented
Search before asking
- I have searched in the issues and found no similar issues.
What would you like to be improved?
When Runtime.getRuntime().availableProcessors() is not obtained correctly or the obtained value is less than or equal to 2, the default value of iceberg is 2, AMS is congested in thread iceberg-work-pool-xx.
How should we improve?
Add parameters in config.yaml to overwrite the value of iceberg.worker.num-threads.
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Subtasks
No response
Code of Conduct
- I agree to follow this project's Code of Conduct
HuangFru commented
This is a java property used by the Iceberg and it can be set in ams.sh like '-Diceberg.worker.num-threads=xxx'.