add <<TestGroup('foo')>> feature or similar (like `@groups` in PHPUnit) to run a specific subset of tests
fredemmott opened this issue · 2 comments
fredemmott commented
For example, the entire test suite of docs.hhvm.com can be ran locally - but a subset, marked with @groups remote
can be ran against a live deployment via HTTP.
With PHPUnit, the docs.hhvm.com deploy process was:
- build container
- run all tests in container
- copy container to staging.docs.hhvm.com
- run 'remote' tests against staging.docs.hhvm.com
- switch cnames between staging.docs.hhvm.com with docs.hhvm.com
#4 isn't possible now
fredemmott commented
A more common case is @groups fast
(expect developers to run this often) and @groups slow
(expect this to pretty much only be ran by CI)
fredemmott commented
Done.