getgauge/html-report

Add ability to see failed retries in html-report (using gauge native retries)

gadgadskiy opened this issue · 6 comments

Please add ability to attach failed steps or logs in html-report if test was passed after 2nd/3rd try using native gauge retrying mechanism. Currently we can see fails only in build log, but in report there's showing only last (successful) result. And it isn’t obvious that test is flaky.

Steps to reproduce

  1. Run test with retrying (gauge run --max-retries-count=2 or gauge:execute -Dflags=--max-retries-count=2 on TeamCity)
  2. One of steps in test should fail first time and pass second time.

Expected behavior

There's some mark or logs in html report that step was failed one time.

Actual behavior

Nothing in report shows that there was failed tries.

Gauge version

1.0.6+

The PRs have been raised to address the issue. The feature will be available in next release

Here are some screenshots showing how this would look like

  • When a scenario passes after few retries

Screenshot 2020-04-23 at 1 11 27 PM

  • When a scenario fails even after max retries

Screenshot 2020-04-23 at 1 13 32 PM

Will we have some options to add some data about failed attempts to html-report?
like some logs/screenshots etc?

zabil commented

Can you please raise another issue for that?

For now it will be a simple marker. Adding more info about previously failed tests will require more thinking and effort.

Can someone please confirm if this feature added to the json-report as well? A property to identify "Retried times" in JSON report

zabil commented

This feature is not available in JSON report. Please create and issue (or PR) at https://github.com/getgauge-contrib/json-report/issues