unneon/icie

Stop execution of tests after TLE or MLE

mikaelmello opened this issue · 5 comments

mikaelmello commented

Self-explanatory

I'm just listing some improvements that I'd like to implement in the near future

unneon commented

Simply stopping is definitely not the good behavior - usually a later test can get a RE which can be debugged in seconds rather than minutes. If the problem is the long wait for results, I was thinking of displaying test outcomes live rather than waiting for all to finish.

mikaelmello commented

Simply stopping is definitely not the good behavior

I guess you're right, regarding MLE a simple warning would suffice.

My reasoning for this issue came from having a lot of hanging executions eating up all my CPU, clicking Cancel on the notification didn't seem to really work.

unneon commented

If that's the case, then I think the spawning and executing code should be fixed instead. I will have to look into it, because it shouldn't spawn multiple tests simultaneously.

mikaelmello commented

If I had to guess, each hanging process came from a different "test run" (Alt+0). My code had an infinite loop and the extension failed to kill it when I clicked on Cancel.

unneon commented

Thanks, that narrows it down pretty tightly!