Performance drop on v4.22.0 onwards
tommeier opened this issue · 4 comments
Hi,
I'm unsure of cause yet, but we're seeing significant performance drops for v4.22.0 onwards. We have a pretty significant suite that generally averages around ~31 minutes per build, with v4.22.0 this increases to ~45 minutes.
Something in this diff:
v4.21.1...v4.22.0
I've tested on v4.22.1 also and the issue persists.
Locking our builds to v4.21.1 solves performance issues.
Most likely #422 did affect the performance in your case.
I would try to play with waitForIdleTimeout and/or waitForSelectorTimeout settings to reduce possible delays in elements location. The other solution could be to make sure the application under test does not hog the UI thread for too long
These are only assumptions though. We'd need more detailed information/comparison about what and where takes too mach time in order to apply any fixes.
@mykola-mokhnach yup sure, no change with timeout tweaks, this is the difference in performance before/after/reverted on our average times:
Also seeing many errors of unable to find elements but work, albeit slowly, on retries
Sorry, but I need more boring details. The chart above does not help much