arthur-ai/bench

Compare test run UI bug for suite with no reference

Closed this issue · 1 comments

The QA Correctness scorer (as well as other scorers) does not require/allow reference outputs, so I didn't include them in my test suite. But it looks like the compare test table still has a column for REFERENCE OUTPUTS even when my suite lacks them, which causes an accidental shift in all the data one column to the left:

Screenshot 2024-03-27 at 11 49 43 AM

Hi @max-arthurai thanks for opening this issue. Please see #116 for a potential fix