IF-AT-scored physics midterm and final exams yield good test reliability (α = 0.71 and 0.82; α50 = 0.86 and 0.90)¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2013 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2016: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The IF-AT-administered midterm and final examinations yielded Cronbach's alpha of 0.71 and 0.82 respectively, rising to 0.86 and 0.90 when adjusted to a standard 50-item test length, which the author calls very reliable for classroom exams. → Slepkov 2013
Evidence¶
Slepkov 2013¶
Slepkov, A. D. (2013). Integrated Testlets and the Immediate Feedback Assessment Technique. https://arxiv.org/abs/1308.4365 doi:10.48550/arxiv.1308.4365
q2 · i? · the article prints no effect size for this finding · design · r2
Reliability analysis of the two case-study examinations, whose unadjusted Cronbach's alpha values were 0.71 (midterm) and 0.82 (final). The author reports "very reliable for classroom exams" after length adjustment to 50 items.
"When our exam reliabilities are adjusted to correspond to a test length of 50 items (see Reference 24 for formulas), our obtained values of α 50 = 0. 86 and 0.90 allow for comparisons with a wide group of other MC tests,20 and are found to be very reliable for classroom exams."
Discussion¶
Related Claims¶
- Polychotomously scored IF-AT physics exam items show excellent discrimination, with a mean item-total correlation of r′ = 0.41 ± 0.13 across 45 items — related
- Intra-testlet items were slightly more difficult than stand-alone questions (p′ = 0.69 ± 0.15 vs 0.75 ± 0.15) — related
- Teacher-belief and competence/value scales show high internal consistency (alphas .92 and .89), while the social-activity and excellence scales are weaker (.65 and .69) — related
- Undergraduate physics students react highly positively to the IF-AT format — related
- Unreliability in an outcome measure reduces the statistical power of treatment-control comparisons — related
- The post-study survey instrument showed high internal consistency (alpha = 0.90) — related
- An exam with low internal consistency cannot be used to verify peer assessment validity — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
if-at-exams-good-reliability |
title |
IF-AT-scored physics midterm and final exams yield good test reliability (α = 0.71 and 0.82; α50 = 0.86 and 0.90) |
description |
IF-AT-scored physics midterm and final exams yield good test reliability (α = 0.71 and 0.82; α50 = 0.86 and 0.90) |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2013 |
source_checked |
2026-10-20 |
recheck_by |
2016 |
generated |
by process:wiki-ingest on 2026-09-26 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — slepkov-2013 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.