Adapting the scoring mechanism substantially reduced ceiling effects found in the pilot study¶
Claim · All claims
Evidence · 1 study · designr3·q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The revised two-point scoring scheme reduced ceiling effects from six scales in the pilot to two scales in Validation Study 1. → Laura Dörrenbächer-Ulrich 2024
Evidence¶
Laura Dörrenbächer-Ulrich 2024¶
Laura Dörrenbächer-Ulrich, Jörn R. Sparfeldt, Franziska Perels. (2024). Knowing how to learn: development and validation of the strategy knowledge test for self-regulated learning (SKT-SRL) for college students. Metacognition and Learning. https://doi.org/10.1007/s11409-024-09379-w
q2 · i? · design · r3
Comparison of ceiling-effect percentages across the pilot (N = 143) and Validation Study 1 (N = 99) after revising scoring so differences of 2 or 3 points earned 2 points instead of 1, aiming to better represent differing knowledge levels.
"the ceiling effects were substantially reduced and were only present in two scales (compared to six scales in the pilot study). This underlines the adequacy of the adapted SKT-SRL scoring mechanism."
Discussion¶
Related Claims¶
- A 200-student pilot showed strong content validity across relevance, comprehensiveness, comprehensibility, and face validity — related
- Two rubric dimensions (claims and evidence, comparison) showed low inter-scorer consistency in the pilot — related
- SKT-SRL scores did not correlate significantly with high school GPA in the pilot and validation studies — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
skt-srl-scoring-reduced-ceiling-effects |
title |
Adapting the scoring mechanism substantially reduced ceiling effects found in the pilot study |
description |
Adapting the scoring mechanism substantially reduced ceiling effects found in the pilot study |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2024 |
generated |
by process:wiki-ingest on 2026-10-19 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — laura-dörrenbächer-ulrich-2024 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.