Udayraj123/OMRChecker

[Feature] Generate a software accuracy report

Udayraj123 opened this issue · 1 comments

Requirements

Software accuracy report

  • We can assume that a ground-truth CSV output is provided, which can be matched with OMRChecker's output and get an accuracy score/report.
  • Need to list the erroneous changes and show the marked images for them.
  • We can get an accuracy number based on review portal's output (ground truth)

Ideas to start with

  • We can match OMRChecker's output with provide ground truth and display an accuracy score
  • Create a report from the mismatches to highlight which questions/question blocks were most mismatched(#39)

Further ideas

This implementation can be extended to create a test benchmark for any existing OMR checking software. We need to blackbox the logic and standardise the inputs and outputs in this case.