Testing mode and question difficulty interact on test scores, with paper advantaged as difficulty increases¶
Claim · All claims
Evidence · 1 study · causalr2·q3
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? The mode*difficulty interaction on test scores was significant (F(1,759.66) = 63.14, p < 0.001), with computer-based testing advantaged on easy questions and paper-based testing advantaged on difficult questions. → James Pengelley · Peter R. Whipp · Nina Rovis-Hermann 2023
Evidence¶
James Pengelley · Peter R. Whipp · Nina Rovis-Hermann 2023¶
James Pengelley · Peter R. Whipp · Nina Rovis-Hermann. (2023). A Testing Load: Investigating Test Mode Effects on Test Score, Cognitive Load and Scratch Paper Use with Secondary School Students. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09781-x
q3 · i? · causal · r2
Hierarchical linear modelling of test scores in the repeated-measures study found "a significant main effect for mode (F(1,767.18) = 4.07, p = 0.044)" and for difficulty, plus the significant mode*difficulty interaction reported in the quote.
"there was a significant main effect for mode (F(1,767.18) = 4.07, p = 0.044); difficulty (F(1,7.82) = 570.92, p < 0.001); and also for the mode*difficulty interaction (F(1,759.66) = 63.14, p < 0.001)"
Discussion¶
Related Claims¶
- Students perform better on easy computer-based questions than on easy paper-based questions — a narrower finding that bears on this claim
- Students rate paper-based questions as more difficult than equivalent computer-based questions — related
- Students invest more mental effort in paper-based questions than in equivalent computer-based questions — related
- Students use scratch paper more in paper-based tests, and scratch paper use during computer-based tests decreases as question difficulty increases — related
- Testing mode effects on test score become nonsignificant when controlling for working memory capacity, but the mode*difficulty interaction remains significant — related
- Secondary students score higher on difficult paper-based questions than on equivalent difficult computer-based questions — a narrower finding that bears on this claim
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
mode-difficulty-interaction-test-score |
title |
Testing mode and question difficulty interact on test scores, with paper advantaged as difficulty increases |
description |
Testing mode and question difficulty interact on test scores, with paper advantaged as difficulty increases |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2023 |
generated |
by process:wiki-ingest on 2026-10-22 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — james-pengelley-peter-r-whipp-nina-rovis-hermann-2023 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.