leonid-shevtsov/split_tests

-line-count option skips some tests and run other tests twice

curpeng opened this issue · 1 comments

We run test build with 4 groups in such way:

bundle exec rspec $(./split_tests -line-count -split-index=0 -split-total=4) --color --tty
bundle exec rspec $(./split_tests -line-count -split-index=1 -split-total=4) --color --tty
bundle exec rspec $(./split_tests -line-count -split-index=2 -split-total=4) --color --tty
bundle exec rspec $(./split_tests -line-count -split-index=3 -split-total=4) --color --tty

and we noticed that our tests sometimes are broken after merging even if branch was rebased with develop and latest test build was green. We turned on documentation format for rspec and saw that some tests are executed twice and some tests are missed.

this was probably caused by bugs in zglob. closing for old age, but i'll keep an eye on our test suite.