symflower/eval-dev-quality

Assess failing tests

zimmski opened this issue · 1 comments

Writing a test suite sometimes results in failing tests.

  • A failing test that compiles is always better than no test at all.
  • A failing test is worse than a passing test.
  • A failing test that covers nothing is worse than a failing test that covers something
  • ...

failing tests for transpilation are even worse cause that essentially means the transpilation is incorrect