decoding results in run_native.py
sobuch opened this issue · 0 comments
sobuch commented
In run_native.py benchmark runtimes are measured using time -p
command. Lets say we have different runs with durations 1.5s and 1.05s, we can simply simulate the results and see the difference:
$ time -p sleep 1.5
real 1.50
user 0.00
sys 0.00
$ time -p sleep 1.05
real 1.05
user 0.00
sys 0.00
However, code in function decode_results will produce the same output for both. This seems to be caused by https://github.com/embench/embench-iot/blob/master/pylib/run_native.py#L66 because:
>>> '{:<03d}'.format(5)
'500'
>>> '{:<03d}'.format(50)
'500'
Is this interpretation of results intentional?