Peer assessment systems can generate explanatory feedback for students by having graders assess multiple labeled aspects of an answer, not just an overall grade.¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Having peer graders assess multiple labeled aspects of an answer (e.g., quality of composition, specific competencies) in addition to an overall grade enables the system to return feedback explaining the overall grade. → Luaces 2018

Evidence¶

Luaces 2018¶

Luaces, O., Díez, J., & Bahamonde, A. (2018). A peer assessment method to provide feedback, consistent grading and reduce students’ burden in massive teaching settings. Computers & Education. https://doi.org/10.1016/j.compedu.2018.07.016

q2 · i? · design · r2

The method asks peer graders to score a set of instructor-defined labels (annotations) about each answer, alongside the overall grade; these labels are then used to construct feedback explaining the final grade to the answer's author.

"The proposal requires graders to assess a number of annotations or labels about the answer that they are assessing. The overall grade is another label in this context."

Discussion¶

Related Claims¶

• A matrix factorization model trained on sparse peer assessment data can predict grades for answers from students who did not participate in grading, reducing the grading burden on students. — related
• Human Graders of Open-Ended Work Agree With Each Other Less Than Treating One Grade as Ground Truth Implies — related
• Prompt quality and detailed scoring rubrics significantly influence the accuracy and consistency of LLM-generated grades — related