chilio/laravel-dusk-ci

Multiple runners at same time

Opened this issue · 4 comments

Hi there,

Would it be easy to setup two or more runners to split tests?

Our CI has lots of tests and it now takes >20mn to run.

Thanks

Hi @HugoHeneault,
unfortunately no.
You should not even try to split your tests.
Pls consider it as a bad practice.

If you have a long running scripts, consider caching elements taking long time.
If your tests by itself are causing excessive time then you should review your code or your infrastructure (maybe it is just too slow)

We have a 70$ - 16 core CI runner. More than 200 tests (huge project)
Each dusk test is slow (even on a macbook) and takes about 2-3s each.

We did manage to split our tests between 6 runners on the same machine and that reduced the dusk tests time by 3.

Why would it be a bad practice?

Hi @HugoHeneault,
normally huge project has thousands or even more tests.
If you split them between many other machines than you probably hit the problem of troubleshooting where the error comes from.
Did you try using caching mechanisms in the first place?

Things taking long time is juste opening the browser.

Are your test running sub second?

We're splitting and we're quite happy with it.