Scaffolded Peer Review¶

Strategy · All strategies
Evidence · 4 claims (4 for) · 9 studies (4 quant-synthesis, 3 causal, 1 review, 1 associational), q2–q4 · 3 of 9 report an effect size

Description¶

Scaffolded peer review organizes peer assessment so that learners receive structured support in giving and receiving critique: exemplars of strong and weak work, rubrics or criterion-referenced prompts, a narrowed feedback scope, and instructor modeling of constructive commentary. The scaffolding addresses the two documented weaknesses of unstructured peer review — vague, unactionable feedback and learner discomfort with critique — and is faded as reviewers gain competence.

Design Implications¶

Peer review doubles as assessment and learning: reviewing others' work requires learners to evaluate artifacts against criteria, which deepens their own understanding of quality Peer assessment can improve learning outcomes comparable to instructor assessment when structured. [+M]. But unstructured review often produces generic praise ("good job") that neither helps the author nor the reviewer; prompts that direct attention to specific criteria and require explanation convert reviewing into an act of Self-Explanation-like elaboration Reviewing with criterion prompts produces more specific, actionable feedback than open-ended review. [+M].

Context¶

Requirements¶

• Exemplars of high-quality work, ideally anonymized student samples, analyzed as a class before independent review
• A rubric or structured prompt set that scopes feedback to one or two dimensions at a time
• Instructor modeling of constructive critique language (Coaching or a think-aloud over a sample review)
• A classroom norm that critique targets the work, not the person
• A mechanism for authors to act on feedback (revision), so review feeds a cycle rather than a verdict

Constraints¶

• Unstructured or rubric-free peer review yields vague feedback that authors cannot act on [-M]
• Learners with low confidence in their own competence give hedged, non-committal feedback; scoping to a single dimension reduces this anxiety but does not eliminate it [~M]
• Peer grades are unreliable for high-stakes summative decisions, particularly when the work is complex or the criteria are subjective [-M] — reserve peer review for formative purposes
• Reviewers cannot give feedback beyond their own expertise; in heterogeneous groups, weak reviewers may reinforce misconceptions [~W]
• Setup is time-consuming: building exemplars, training reviewers, and managing anonymity all add instructor load in early iterations

Implementation Variability¶

• Calibrated review: reviewers first rate instructor-anchored samples and receive accuracy feedback before reviewing peers (used by SWoRD/Peerceptiv)
• Scoped rounds: each round addresses one criterion (e.g., argument structure, then evidence use), reducing cognitive load
• Erroneous examples: reviewing a deliberately flawed sample builds evaluative skill without interpersonal risk Reviewing flawed examples builds conceptual knowledge of quality criteria. [+M]
• Reciprocal vs. blind: anonymous review increases candor; reciprocal (known) review increases accountability and follow-up dialogue
• Fading: prompts and exemplars are progressively withdrawn as reviewers calibrate Fading support promotes transfer of responsibility. [+M]

Target Learners¶

• Middle school through higher education; strongest evidence in secondary and post-secondary writing and design courses [+M]
• Learners who are anxious about critique benefit most from exemplar analysis and scoped prompts before reviewing peers
• Less effective for novices who lack enough domain knowledge to judge quality at all — they need Worked Examples and instructor modeling first [~M]

Target Learning Goals¶

• Evaluative judgment: internalizing criteria for quality work
• Writing and revision skills: authors revise more substantively when feedback is specific and criterion-referenced [+M]
• Metacognition and self-regulation: reviewing others' work transfers to self-assessment of one's own drafts
• Collaborative norms: building a culture where constructive criticism is expected and welcomed

Instructions¶

1. Analyze exemplars as a class, contrasting strong and weak samples to make quality criteria explicit (Comparing Cases or Non-Examples)
2. Model a review aloud, demonstrating constructive critique language and criterion-referenced comments (Coaching)
3. Distribute a rubric or structured prompt set that scopes feedback to one dimension per round (Assessment for learning, not of it)
4. Conduct the peer review exchange, ideally anonymously, with each author receiving feedback from 2–3 reviewers
5. Have authors revise based on feedback and optionally rate the helpfulness of comments received
6. Fade supports over successive cycles: fewer prompts, broader scope, more reviewer autonomy

Related Strategies¶

• Calibrated Peer Review — a specific technology-supported implementation of the calibration variation
• Revision Cycles — the author-side half of the review loop
• Peer-delivered prompts in which students take over prompting, feedback, and assessment from an instructor

Related Elements¶

• Coaching — instructor modeling of critique is the training phase for reviewers
• Assessment — peer review enacts assessment for learning when feedback drives revision
• Class Discussion — whole-class exemplar analysis builds shared criteria
• Peer Discussion — the dialogue layer that turns one-way comments into negotiation of meaning

Tools¶

• Peerceptiv (formerly SWoRD) — calibrated peer review with reviewer-accuracy scoring
• Peergrade — anonymous peer feedback with rubric templates
• Eli Review — structured revision-focused peer feedback for writing courses

Examples¶

• Calibrated Peer Review (CPR) in undergraduate chemistry: students first review instructor-authored calibration samples with known quality, then review peers' lab reports against a rubric (https://cpr.molsci.ucla.edu)
• A high school English teacher analyzes two anonymized student essays as a class, limits the first review round to thesis clarity only, and requires each comment to reference the rubric — reducing reviewer anxiety and raising comment specificity

Key Sources¶

• Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276. doi:10.3102/00346543068003249
• Cho, K., & Schunn, C. D. (2007). Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system. Computers & Education, 48(3), 409–426. doi:10.1016/j.compedu.2005.02.004
• Gielen, S., Dochy, F., & Onghena, P. (2011). An inventory of peer assessment diversity. Assessment & Evaluation in Higher Education, 36(2), 137–155. doi:10.1080/02602930903221444
• Double, K. S., McGrane, J. A., & Hopfenbeck, T. N. (2020). The impact of peer assessment on academic performance: A meta-analysis of control group studies. Educational Psychology Review, 32, 153–179. doi:10.1007/s10648-019-09510-3