[Feature] Generate a software accuracy report
Udayraj123 opened this issue · 1 comments
Udayraj123 commented
Requirements
Software accuracy report
- We can assume that a ground-truth CSV output is provided, which can be matched with OMRChecker's output and get an accuracy score/report.
- Need to list the erroneous changes and show the marked images for them.
- We can get an accuracy number based on review portal's output (ground truth)
Ideas to start with
- We can match OMRChecker's output with provide ground truth and display an accuracy score
- Create a report from the mismatches to highlight which questions/question blocks were most mismatched(#39)
Further ideas
This implementation can be extended to create a test benchmark for any existing OMR checking software. We need to blackbox the logic and standardise the inputs and outputs in this case.