datacommonsorg/mixer

Investigating GKE memory and cpu resource limit setup

shifucun opened this issue · 1 comments

Currently we set container cpu and memory, but have been bitten a few times for requests that takes up cpu and memory. It turns out large request like /stat/set/within-place of <Europe, IPCCPlace_50> uses peak CPU of 3000m and get throttled. Following are some read about not setting limit:

https://erickhun.com/posts/kubernetes-faster-services-no-cpu-limits/
https://medium.com/omio-engineering/cpu-limits-and-aggressive-throttling-in-kubernetes-c5b20bd8a718

We should try to remove the resource limit and see if it works.

@pradh @beets please take a look at the articles and see if they make sense