Reporting formats for test outputs

Question

Reporting formats for test outputs

ttutisani opened this issue 5 years ago · 7 comments

I have not received much demand for report formats for test outputs but there may be some interest (somebody asked this question on Reddit).

If you are reading this issue and want to generate test output in a certain format, please reply here and explain your needs.

All responses will be considered for future development if there is demand and if it fits in the scope of this framework.

Answer 1 · 2019-12-10T18:51:51.000Z

I'm interested in this. I'd like something like PicklesDoc or maybe the cucumber report format? I'll look into more and get back on this.

I have 2 fold wants.
Documentation
Test run report

Answer 2 · 2020-01-10T00:50:45.000Z

Hi @danswain

Can you please elaborate on your ask?
Does this help? https://github.com/ttutisani/Xunit.Gherkin.Quick/blob/master/docs/picklesdoc-test-results.md

Answer 3 · 2021-12-06T11:14:57.000Z

Hello,

We would be interested for Cucumber JSON report format to be used on XRay (JIRA Plugin) as a Cucumber Test instead of Generic Test (limitation of XRay).

This can improve our automatic BDD testing.
https://docs.getxray.app/pages/viewpage.action?pageId=37076136
"As long as these different flavors are able to produce a compatible Cucumber JSON report, then those results can be seen and managed in Xray."

Answer 4 · 2021-12-06T13:44:09.000Z

Here is what I think about these formats in general: I now think that not all reporting formats belong in the framework itself. There needs to be some extensibility (maybe via Strategy or Plugin pattern) developed that will allow injecting various reporting format generators. This is a high-level idea, but in general, setting expectations for the framework.

There can be hundreds of report formats that are useful with different tools and in different scenarios, and understandably, not all of them will be natively implemented within the framework itself.

Answer 5 · 2021-12-06T18:26:23.000Z

I totaly agree with you. But cucumber JSON format seems legitimate to be "natively implemented within the framework itself" as cucumber seems to be the "norm" for every tool on BDD, XGQ is even listed as semi-official cucumber implementation: https://cucumber.io/docs/installation/

Answer 6 · 2021-12-06T18:42:16.000Z

Agreed, that could be the case as well.

Answer 7 · 2022-08-25T22:35:58.000Z

Any chance with Allure?

Btw very cool job!