scalameta/munit

Unhandled errors in tests reported incorrectly in XML reports

shardulc opened this issue · 0 comments

Expected behavior: When an unhandled error occurs during the execution of a test, it is reported (in the JUnit-style XML reports under target/test-reports/) as an <error>. Although I couldn’t find an authoritative definition or explanation of the XML schema, the following sources all agree that <error> is the correct element in this case:

In addition, reports produced by ScalaCheck also have an <error>.

Observed behavior: The XML report produced by MUnit has a <failure> which is supposed to be for tests that fail an assertion or a check.

Steps to reproduce: In shardulc/munit-scalacheck-error-repro.