facebook/FAI-PEP

When running multiple tests, failures can be "swallowed"

jteller opened this issue · 1 comments

We run multiple tests from a single config, and introduced an error in the second test in the group. This failure was not noticed, because each test reuses the same temp directory so report.json from the previous run is reused. That means that even though the run fails, we report data for the previous run.

I just tested, and #126 fixes my issue (failure will result in no data posted to the screen or remote reporter: which is the desired behavior).