Performance benchmarking
hsanjuan opened this issue · 2 comments
I tested Kubo 0.23.0 vs Rainbow (master) on Thunderdome.
We see rainbow is like 5x faster in ttfb metrics:
Rainbow uses many less resources than Kubo. I.e. 10x less mean heap usage. 5x less goroutines. 6x less CPU.
Rainbow has similar request metrics, seems to be slightly faster.
Looking in the time dimension, Kubo has waves where TTFB increases greatly, where rainbow doesn't:
In general Rainbow appears to be much more performance in terms of resource usage than Kubo, for slightly better results when processing requests in terms of return codes (with the exception of TTFB, where rainbow is much better), although we see similar graphs of dropped requests/timeouts:
As per the triage meeting, I'm closing this issue. There's no actionable items in this issue, and there are already Grafana dashboard where we can currently monitor Kubo and Rainbow.
Thunderdome improvements will be tackled separately.