sbabcoc/JUnit-Foundation

Issues running in parallel, especially with parameterized tests

Closed this issue · 1 comments

sbabcoc commented

These issues were reported against junit-foundation-6.3.1:

  • When running in parallel, event notifications got sent with the wrong context.
  • In many scenarios with parameterized tests, the event notification code would throw exceptions (e.g. - NullPointerException), resulting in false test failures.
  • Due to missing intercept hooks, we would miss key events.
  • There was no code in place to recognize nested interceptions, resulting in duplicate notifications.
sbabcoc commented

To resolve these issues, I tried multiple strategies both minor and major. The initial commit for this extensive collection of changes was this one. The complete set of revisions is contained in 53 commit, published in 7 release:

This final release resolves the reported issues and other fundamental problem I discovered along the way. The end result is a properly-functioning event notification system hooked into public or protected interfaces. This code has been verified with parallel execution of parameterized tests.