Five-hypothesis validation process for online peer assessment¶
Research Method · All research methods
Evidence · 2 claims (2 for) · 1 study (1 design),q2· 0 of 1 report an effect size · 2 claims rest on one study
Description¶
The article proposes a validation procedure in which peer assessment may only be judged valid after five prior conditions are confirmed: teacher reliability, correct test items, internal consistency of the test, reliability of the observation and marking tools, and clear, coherent marking instructions and scale schemes. The authors state that "a method which requires that five hypotheses must be confirmed before checking the validity of peer assessment" was used, operationalised through expert comparison, item analysis (difficulty and discrimination indexes), Cronbach's alpha, tool checks, and marking-scheme coherence checks before a final teacher-peer agreement analysis.
Accounts¶
- Five-hypothesis validation process for online peer assessment: The article proposes a validation procedure in which peer assessment may only be judged valid after five prior conditions are confirmed: teacher reliability, correct test items, internal consistency of the test, reliability of the observation and marking tools, and clear, coherent marking instructions and scale schemes. The authors state that "a method which requires that five hypotheses must be confirmed before checking the validity of peer assessment" was used, operationalised through expert comparison, item analysis (difficulty and discrimination indexes), Cronbach's alpha, tool checks, and marking-scheme coherence checks before a final teacher-peer agreement analysis. (Bouzidi et al. (2009))
Claims¶
- Item analysis flags items whose marking instructions mislead peer assessors [+M]
- An exam with low internal consistency cannot be used to verify peer assessment validity [+M]
Related Research Methods¶
-
Key Sources¶
- Bouzidi, L., & Jaillet, A. (2009). Can Online Peer Assessment be Trusted?. Educational Technology & Society, 12(4), 257-268. https://www.ifets.info/
Page metadata
| Field | Value |
|---|---|
type |
research-method |
id |
five-hypothesis-validation-process-for-online-peer-assessment |
title |
Five-hypothesis validation process for online peer assessment |
description |
The article proposes a validation procedure in which peer assessment may only be judged valid after five prior conditions are confirmed: teacher reliability, correct test items, internal consistency of the test, reliability of the observation and marking tools, and clear, coherent marking instructio |
status |
review |
generated |
by process:settle-candidates on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.