jenkinsci/peass-ci-plugin

Better display of unexecuted tests (because of generateCoverageSelection: true) in Peass Overview

Closed this issue · 2 comments

What feature do you want to see added?

If you set generateCoverageSelection: true and e.g. two TestCases call changes in a commit but only one TestCase is executed for measurement (because it calls the changes more often than the other), you see an error in Peass Overview Results for the unexecuted TestCase. This is not really an error. The TestCase was not executed for a reason.
Field telling you "unmeasured" should maybe be yellow instead of red. So you will recognize that the TestCase was not executed because measurements took place using the TestCase which calls the changes more often.

Upstream changes

No response

This should work since 3fa7455, can you confirm this?

If a test is not executed because another one calls the changes more often, in overview you now read: "This test was not selected by dynamic selection: COVERAGE_SELECTION"
So this works.