openedx/edx-ora2

"Escalation" workflow to break ties, handle large discrepencies in feedback.

Opened this issue · 1 comments

e0d commented

flexibility to add graders/staff tosome submissions as necessary(e.g. when we see 2 peer scoresdiffer by a huge amount- Ability to edit a single instance of a peer grade of an ora response (teacher grade overrides one of the peer scores and then recalculates)

Yes, I often see requests for Faculty Override. I think any submission should have the option of faculty override for simplicity sake.
And maybe a simple way to do this is have a "grade confidence" calculation or something that just highlights submissions with a wide deviation between scores (red for wide deviation. Green for small deviation. yellow in between), and then faculty can look at those and determine if they need to intervene.