Secondary students score higher on difficult paper-based questions than on equivalent difficult computer-based questions¶
Claim · All claims
Evidence · 1 study · causalr2·q3
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Students performed better on difficult paper-based questions (M = 1.50) than difficult computer-based questions (M = 1.03), a difference of 11.5% of the total possible score. → James Pengelley · Peter R. Whipp · Nina Rovis-Hermann 2023
Evidence¶
James Pengelley · Peter R. Whipp · Nina Rovis-Hermann 2023¶
James Pengelley · Peter R. Whipp · Nina Rovis-Hermann. (2023). A Testing Load: Investigating Test Mode Effects on Test Score, Cognitive Load and Scratch Paper Use with Secondary School Students. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09781-x
q3 · i? · causal · r2
In the counterbalanced repeated-measures study of 263 year 9 students, hierarchical linear modelling of test scores showed "students performed better on difficult PBT questions (M = 1.50, 95% CI = 0.73, 2.26) compared to difficult CBT questions (M = 1.03, 95% CI = 0.28, 1.79)"; the article states this difference represents 11.5% of the total possible score of 4.
"students performed better on difficult PBT questions (M = 1.50, 95% CI = 0.73, 2.26) compared to difficult CBT questions (M = 1.03, 95% CI = 0.28, 1.79)"
Discussion¶
Related Claims¶
- Students perform better on easy computer-based questions than on easy paper-based questions — related
- Students invest more mental effort in paper-based questions than in equivalent computer-based questions — related
- Testing mode and question difficulty interact on test scores, with paper advantaged as difficulty increases — a broader claim this one bears on
- Students rate paper-based questions as more difficult than equivalent computer-based questions — related
- Students use scratch paper more in paper-based tests, and scratch paper use during computer-based tests decreases as question difficulty increases — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
pbt-outperforms-cbt-difficult-questions |
title |
Secondary students score higher on difficult paper-based questions than on equivalent difficult computer-based questions |
description |
Secondary students score higher on difficult paper-based questions than on equivalent difficult computer-based questions |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2023 |
generated |
by process:wiki-ingest on 2026-10-22 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — james-pengelley-peter-r-whipp-nina-rovis-hermann-2023 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.