Exponential test time increase with more examples
DanielVF opened this issue · 1 comments
I'm seeing exponential time increases when adding more examples to my scenario outline.
1x Example - 1.4 seconds
10x Examples - 22 seconds
20x Examples - 136 seconds
100x Examples - Well...
This is with a only a single feature file, containing only a single Scenario Outline. I have a table of 8 integer inputs and 4 integer outputs. I've tried replacing every single function in steps.py and terrain.py with pass
, so that no code of my own is even being called, and it's just as slow (and in any case, my code is doing very fast, simple things).
Running a profile, it looks like it's spending 99.9% of its time in deepcopy copy.py:145
(Though I don't know if the profile is lying maybe the actual tests is running somewhere else)