CommonFormatters Behat extension
An aggregation of extra formatters for Behat supposed to be used commonly.
Installation
See https://github.com/Behat/CommonFormatters/blob/master/doc/index.rst
Formatters that distinguish between an error and a failure in terms of xUnit's notion
See Behat/Behat#111
- A failed step is the equivalent of an error in xUnit.
- A false step is the equivalent of a failure in xUnit (colored magenta by the formatters).
- Actually a false step is a failed step too, it is just a fine-grained interpretation of a failed step (complementarily there can be non-false steps among failed steps).
ProgressWithFalseStepsFormatter
PrettyWithFalseStepsFormatter
HtmlWithFalseStepsFormatter
Formatter that dumps the most important information about a suite run as JSON
JsonFormatter
https://github.com/Behat/CommonFormatters/blob/master/src/Behat/CommonFormatters/JsonFormatter.php
{
date: "2012-11-20: 14:55:31",
features: [
{
"title": "A feature",
"desc": null,
"tags": [
"foo"
],
"result": "passed",
"scenarios": [
{
"title": "A scenario",
"isOutline": false,
"tags": [
"bar"
],
"result": "passed",
"steps": [
{
"text": "some precondition",
"type": "Given",
"isBackground": false,
"result": "passed"
},
{
"text": "some action",
"type": "When",
"isBackground": false,
"result": "passed"
},
{
"text": "some outcome",
"type": "Then",
"isBackground": false,
"result": "passed"
}
]
}
]
}
]
}
Formatter that adds a new line to a CSV file for each suite run
CsvStatisticsFormatter
execution date,total execution time,number of features,number of features with failures,number of scenarios,number of scenarios with failures,number of steps,number of failed steps
Fri 30 Mar 2012 11:36:57,2m44.987s,2,1,39,2,155,2