Peer ratings of programming assignments correlated significantly with instructor ratings, with students more accurate on objective than subjective judgements¶

Claim · All claims
Evidence · 1 study · review r3 · q2
Currency · newest study 2009 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? An evaluation of the Sitthiworachart and Joy system showed peer ratings correlate significantly with instructor ratings, and that students are better able to make accurate objective judgements than subjective ones. → Luxton-Reilly 2009

Evidence¶

Luxton-Reilly 2009¶

Luxton-Reilly, A. (2009). A systematic review of tools that support peer assessment. Computer Science Education, 19(4), 209-232. https://doi.org/10.1080/08993400903384844

q2 · i? · review · r3

The review reports an evaluation of the system developed by Sitthiworachart and Joy (2004) for peer review of programming assignments, which showed that "the peer ratings correlate significantly with instructor ratings." No correlation coefficient is printed.

"An evaluation study showed that the peer ratings correlate significantly with instructor ratings, and that students are better able to make accurate objective judgements than subjective ones."

Discussion¶

Related Claims¶

• In two secondary-school writing studies, peer reviewers' own performance predicted how helpful their feedback was but not how accurately it identified problems — related
• In two online comparisons, a rubric changed what peer reviewers commented on (one study) and helped peer raters place writing in quality tiers, most for complex criteria (the other); the first study says the rubric restrained reflective thinking — related