masukomi/rtest

average time check

Opened this issue · 0 comments

  • we should track the run time for every repo and file path.
  • when beginning a run we should see if we've got recorded runs for it and provide the script with the average run time for this repo/file.
  • while running a file the loop that spits out the marching ants should compare current run time against the average. If we deviate by X%
    • print out a note "Average run length exceeded by 20%"
    • change dot color to red.
  • run length should be recorded in seconds

gotchas:

  • We need to ignore any data from a run that involved stopping at a breakpoint.
  • the loop that does the check needs to know if a breakpoint has been hit earlier so that it can not provide run length warnings for something that's almost guaranteed to be beyond the expected delta.

I think this implies that we have a separate table for run times

project file runtime_length
my_repo foo/bar_spec.rb 33
my_repo null 999