Comparative judgment is a method used in assessment and evaluation to compare and rank different items or performances based on their perceived quality or merit. Instead of assigning absolute scores or grades to individual items, comparative judgment involves comparing pairs of items and determining which is better or of higher quality.
Here's a simplified explanation of how comparative judgment works:
Pairs of Items: Assessors are presented with pairs of items to compare. These items could be student essays, project proposals, artwork, or any other type of work that needs evaluation.
Decision Making: The assessors then make judgments about which item in each pair is better or more desirable based on certain criteria. The criteria can be predetermined or emerge from the assessors' expertise in the subject matter.
Iterative Process: This process is repeated multiple times, with assessors comparing different pairs of items. The software or system organizing the judgments collects the data on the comparisons made by each assessor.
Ranking: The final result is generated by analyzing the collective judgments. Items are ranked based on how often they were chosen as better in the comparisons.
One advantage of comparative judgment is that it allows for a more nuanced and reliable assessment by leveraging the human ability to make qualitative distinctions. It can be especially useful when evaluating complex or subjective tasks where assigning numerical scores may be challenging.
There are both manual and automated ways to implement comparative judgment. Manual methods involve people making the comparisons, while automated systems use algorithms to analyze the data and derive rankings. Automated systems can efficiently handle large-scale assessments, making comparative judgment a versatile approach in various fields, including education, art, and professional evaluations.
Improving Self-Reflection Assessment Practices: Comparative Judgment as an Alternative to Rubrics.
What do mathematicians mean by proof? A comparative-judgement study of students’ and mathematicians’ views.
2020
Title
Publication
Paper
Code
Tags
Notes
Comparative judgement, proof summaries and proof comprehension.
2019
Title
Publication
Paper
Code
Tags
Notes
Teaching using contextualised and decontextualised representations: Examining the case of differential calculus through a comparative judgement technique.
The complexity of assessing student work using comparative judgment: The moderating role of decision accuracy.
An investigation of construct relevant and irrelevant features of mathematics problem-solving questions using comparative judgement and Kelly’s Repertory Grid.
2016
Title
Publication
Paper
Code
Tags
Notes
Measuring conceptual understanding using comparative judgement.
International Journal of Research in Undergraduate Mathematics Education, 2, 141–164.