average time check
Opened this issue · 0 comments
masukomi commented
- we should track the run time for every repo and file path.
- when beginning a run we should see if we've got recorded runs for it and provide the script with the average run time for this repo/file.
- while running a file the loop that spits out the marching ants should compare current run time against the average. If we deviate by X%
- print out a note "Average run length exceeded by 20%"
- change dot color to red.
- run length should be recorded in seconds
gotchas:
- We need to ignore any data from a run that involved stopping at a breakpoint.
- the loop that does the check needs to know if a breakpoint has been hit earlier so that it can not provide run length warnings for something that's almost guaranteed to be beyond the expected delta.
I think this implies that we have a separate table for run times
project | file | runtime_length |
---|---|---|
my_repo | foo/bar_spec.rb | 33 |
my_repo | null | 999 |