[FEATURE] introduce jemalloc to optimize memory usage
mddxhj opened this issue · 7 comments
mddxhj commented
Is your feature request related to a problem? Please describe.
I found after introducing jemalloc celeborn gains a better memory usage when deploying for flink on k8s.
Describe the solution you'd like
Introduce jemalloc for celeborn
Describe alternatives you've considered
waitinfuture commented
Hi @mddxhj , thanks for your input! BTW, are you interested in raising a PR for this?
mddxhj commented
@waitinfuture yes，I'll raise a pr for this feature
waitinfuture commented
@waitinfuture yes，I'll raise a pr for this feature
That's great!
pan3793 commented
... gains a better memory usage ...
Could you share more information like metrics to prove such improvements?
mddxhj commented
@pan3793 I have a case in our production environment, single pod work_set usage decreased from 9.3GB to 6GB approximately after enable jemalloc. see CELEBORN-900