ArielMAJ/test.me

[BUG] Incorrectly passing tests

ArielMAJ opened this issue · 0 comments

Describe the bug
This tool was probably coded (initially) to check if the expected output is part of the actual output (or the other way around). This means they can differ but the test still pass because the expected output is contained in the actual output. Right after the mvp version of this tool was finished, it already was being used expecting the expected and actual outputs to be the same for a test to pass (instead of contained in each other). In other words, this behavior is now an unhelpful bug.

To Reproduce
TODO

Expected behavior
A test should only pass if all the lines are the same, in the same order with all characters equal. The only ignored characters should be:

  1. White space before and after a single string of characters;
  2. New lines (\r and \n) before and after the start of a block of lines of strings.

eg:


 aaa  
     bbb    
ccc

is the same as:

aaa
bbb
ccc

but different from

bbb
ccc

Screenshots
TODO

Desktop (please complete the following information):

  • OS: Windows (probably same behavior on other platforms).
  • test.me version: 1.1.2 (most likely same behavior on all versions since it was first added).
  • gcc version: 6.3.0

Additional context
Tests may incorrectly pass when they shouldn't if the user prints additional characters before or after the block containing the main content.