Question about hyperfine benchmark results
Pavel-Durov opened this issue · 3 comments
Pavel-Durov commented
I was looking at hyperfine documentation but I couldn't find anything related to the the output format.
How do I read hyperfine benchmark results?
Example:
Time (mean ± σ): 14.9 ms ± 0.7 ms [User: 12.5 ms, System: 2.3 ms]
Range (min … max): 14.0 ms … 21.3 ms 187 runs
min .. max
- minimum and maximum running times
User
- time spent in user space, amount of time spent on the program itself
System
- time spent in system space, amount of time spent on OS functions related to the program
runs
- total count of benchmark runs
What's mean ± σ
? Standard deviation?
Pavel-Durov commented
The way I interpret it:
mean
- is the average execution time of the benchmarks
± σ
- is the standard deviation representing the amount of variation from the mean
Is it somehow correct?
sharkdp commented
@Pavel-Durov does this help?