Holistic peer feedback correlated significantly with tutor marks while specific-criteria rubric feedback did not in the PEARS system¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2009 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? In a PEARS evaluation, there was no correlation between students' scores and tutors' scores when using a rubric with specific criteria, but a significant positive correlation was found when the holistic rubric was used. → Luxton-Reilly 2009
Evidence¶
Luxton-Reilly 2009¶
Luxton-Reilly, A. (2009). A systematic review of tools that support peer assessment. Computer Science Education, 19(4), 209-232. https://doi.org/10.1080/08993400903384844
q2 · i? · review · r2
An evaluation study comparing holistic with specific feedback using the PEARS system found that "a significant positive correlation was found between students and tutors when the holistic rubric was used" but no correlation with the specific-criteria rubric. No correlation coefficient is printed.
"They also found that there was no correlation between the students' scores and the tutors' scores when using the rubric with specific criteria, but a significant positive correlation was found between students and tutors when the holistic rubric was used."
Discussion¶
Related Claims¶
- Peer marks correlate with teacher marks, with a mean correlation of 0.69 across studies in a meta-analysis — related
- An accountability feature allowing students to grade received reviews improved the correlation between expert and peer marks in peerScholar — related
- Rank-based metrics can be misleading for analytic assessment: systems prompted for holistic scoring achieve strong, sometimes stronger, correlations with analytic scores than when prompted for those aspects — related
- Structured criteria in peer assessment are not shown to improve its effect on academic performance over freeform review — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
pears-holistic-feedback-correlates-tutor-marks-specific-does-not |
title |
Holistic peer feedback correlated significantly with tutor marks while specific-criteria rubric feedback did not in the PEARS system |
description |
Holistic peer feedback correlated significantly with tutor marks while specific-criteria rubric feedback did not in the PEARS system |
status |
review |
evidence_strength |
weak |
newest_evidence |
2009 |
generated |
by process:wiki-ingest on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — luxton-reilly-2009 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.