[TURN] benchmark the performance of TURN
Closed this issue · 2 comments
rainliu commented
[TURN] benchmark the performance of TURN
rainliu commented
cargo bench
Benchmarking BenchmarkIsChannelData
Benchmarking BenchmarkIsChannelData: Warming up for 3.0000 s
Benchmarking BenchmarkIsChannelData: Collecting 100 samples in estimated 5.0000 s (2.8B iterations)
Benchmarking BenchmarkIsChannelData: Analyzing
BenchmarkIsChannelData time: [1.6669 ns 1.6804 ns 1.6977 ns]
change: [+31.037% +32.715% +34.522%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
5 (5.00%) high mild
5 (5.00%) high severe
Benchmarking BenchmarkChannelData_Encode
Benchmarking BenchmarkChannelData_Encode: Warming up for 3.0000 s
Benchmarking BenchmarkChannelData_Encode: Collecting 100 samples in estimated 5.0001 s (241M iterations)
Benchmarking BenchmarkChannelData_Encode: Analyzing
BenchmarkChannelData_Encode
time: [20.543 ns 20.692 ns 20.878 ns]
change: [-2.2043% -1.2847% -0.2866%] (p = 0.01 < 0.05)
Change within noise threshold.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
Benchmarking BenchmarkChannelData_Decode
Benchmarking BenchmarkChannelData_Decode: Warming up for 3.0000 s
Benchmarking BenchmarkChannelData_Decode: Collecting 100 samples in estimated 5.0000 s (227M iterations)
Benchmarking BenchmarkChannelData_Decode: Analyzing
BenchmarkChannelData_Decode
time: [21.794 ns 22.033 ns 22.316 ns]
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking BenchmarkChannelNumber/AddTo
Benchmarking BenchmarkChannelNumber/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkChannelNumber/AddTo: Collecting 100 samples in estimated 5.0001 s (97M iterations)
Benchmarking BenchmarkChannelNumber/AddTo: Analyzing
BenchmarkChannelNumber/AddTo
time: [51.667 ns 52.210 ns 52.796 ns]
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking BenchmarkChannelNumber/GetFrom
Benchmarking BenchmarkChannelNumber/GetFrom: Warming up for 3.0000 s
Benchmarking BenchmarkChannelNumber/GetFrom: Collecting 100 samples in estimated 5.0000 s (285M iterations)
Benchmarking BenchmarkChannelNumber/GetFrom: Analyzing
BenchmarkChannelNumber/GetFrom
time: [16.339 ns 17.030 ns 18.282 ns]
Found 12 outliers among 100 measurements (12.00%)
3 (3.00%) high mild
9 (9.00%) high severe
Benchmarking BenchmarkData/AddTo
Benchmarking BenchmarkData/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkData/AddTo: Collecting 100 samples in estimated 5.0001 s (83M iterations)
Benchmarking BenchmarkData/AddTo: Analyzing
BenchmarkData/AddTo time: [61.801 ns 63.083 ns 64.511 ns]
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
Benchmarking BenchmarkData/AddToRaw
Benchmarking BenchmarkData/AddToRaw: Warming up for 3.0000 s
Benchmarking BenchmarkData/AddToRaw: Collecting 100 samples in estimated 5.0002 s (82M iterations)
Benchmarking BenchmarkData/AddToRaw: Analyzing
BenchmarkData/AddToRaw time: [59.431 ns 59.938 ns 60.567 ns]
Found 13 outliers among 100 measurements (13.00%)
6 (6.00%) high mild
7 (7.00%) high severe
Benchmarking BenchmarkLifetime/AddTo
Benchmarking BenchmarkLifetime/AddTo: Warming up for 3.0000 s
Benchmarking BenchmarkLifetime/AddTo: Collecting 100 samples in estimated 5.0002 s (96M iterations)
Benchmarking BenchmarkLifetime/AddTo: Analyzing
BenchmarkLifetime/AddTo time: [53.374 ns 54.374 ns 55.470 ns]
Found 10 outliers among 100 measurements (10.00%)
5 (5.00%) high mild
5 (5.00%) high severe
Benchmarking BenchmarkLifetime/GetFrom
Benchmarking BenchmarkLifetime/GetFrom: Warming up for 3.0000 s
Benchmarking BenchmarkLifetime/GetFrom: Collecting 100 samples in estimated 5.0000 s (279M iterations)
Benchmarking BenchmarkLifetime/GetFrom: Analyzing
BenchmarkLifetime/GetFrom
time: [17.255 ns 17.357 ns 17.479 ns]
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
rainliu commented
benchmarking is done, will create separate issue to track performance improvement based on this benchmark