An exam with low internal consistency cannot be used to verify peer assessment validity¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2009 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2012: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The GEE-2007 exam's item analysis showed Cronbach's alpha of 0.41, so it was excluded from the peer assessment validity verification. → Bouzidi 2009
Evidence¶
Bouzidi 2009¶
Bouzidi, L., & Jaillet, A. (2009). Can Online Peer Assessment be Trusted?. Educational Technology & Society, 12(4), 257-268. https://www.ifets.info/
q2 · i? · design · r2
Item analysis of the GEE-2007 exam (9 items of calculations and mathematical reasoning, 80 students): Cronbach's alpha was 0.41, below the article's cited acceptability band, so the exam "could not" serve the validity check.
"As regards the GEE-2007 exam, the item analysis showed low reliability (0.41). Consequently, we could not use it to verify the peer assessment validity."
Discussion¶
Related Claims¶
- Stealth assessment facets show good internal consistency (Cronbach's alpha = 0.76) while MicroDYN reliabilities were low in this middle-school sample — related
- A high Cronbach's alpha across items measuring distinct knowledge aspects indicates the test is not working as intended — related
- IF-AT-scored physics midterm and final exams yield good test reliability (α = 0.71 and 0.82; α50 = 0.86 and 0.90) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
low-reliability-exam-excluded-from-validity-check |
title |
An exam with low internal consistency cannot be used to verify peer assessment validity |
description |
An exam with low internal consistency cannot be used to verify peer assessment validity |
status |
review |
evidence_strength |
weak |
newest_evidence |
2009 |
recheck_by |
2012 |
generated |
by process:wiki-ingest on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — bouzidi-2009 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.