[BUG] Incorrectly passing tests
ArielMAJ opened this issue · 0 comments
Describe the bug
This tool was probably coded (initially) to check if the expected output is part of the actual output (or the other way around). This means they can differ but the test still pass because the expected output is contained in the actual output. Right after the mvp version of this tool was finished, it already was being used expecting the expected and actual outputs to be the same for a test to pass (instead of contained in each other). In other words, this behavior is now an unhelpful bug.
To Reproduce
TODO
Expected behavior
A test should only pass if all the lines are the same, in the same order with all characters equal. The only ignored characters should be:
- White space before and after a single string of characters;
- New lines (\r and \n) before and after the start of a block of lines of strings.
eg:
aaa
bbb
ccc
is the same as:
aaa
bbb
ccc
but different from
bbb
ccc
Screenshots
TODO
Desktop (please complete the following information):
- OS: Windows (probably same behavior on other platforms).
- test.me version: 1.1.2 (most likely same behavior on all versions since it was first added).
- gcc version: 6.3.0
Additional context
Tests may incorrectly pass when they shouldn't if the user prints additional characters before or after the block containing the main content.