[T.2.3] Add ReBenchDB Result Comparability Analysis
Opened this issue · 0 comments
smarr commented
Expand ReBenchDB's support for data provenance by detecting environmental differences that affect the comparability of results. Operating system, software, or CPU microcode updates
can change performance and make comparison with historic data invalid.
By highlighting differences and providing confidence levels, awareness of such external variables will increase and help research to judge whether comparisons are meaningful.