Meeting four or more implementation fidelity criteria is associated with course grades about 0.24 points higher than expected, a 0.58 grade-point swing versus meeting only two criteria.¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Instructors meeting more of seven fidelity criteria had classes with better-than-expected grade outcomes. → Barbara Means 2026
Evidence¶
Barbara Means 2026¶
Barbara Means, Julie Neisler, Daniel Parker, Vanessa Peters Hinton, and Emily Pressler. (2026). Lessons From Implementing Courseware in Gateway Statistics Courses. Digital Promise. https://digitalpromise.dspacedirect.org/items/12bb84f5-0073-40e6-85bb-41561222891b doi:10.51388/20.500.12265/292
q2 · i? · associational · r2
Analysis of 2024-25 classes assessed against seven fidelity criteria developed with Lumen Learning. Students of instructors meeting "four or more criteria" had "grades about 0.24 points higher than expected"; those meeting only two criteria had grades "about 0.34 grade points lower."
"Students of instructors who met four or more criteria for implementation fidelity had an unadjusted course pass rate of 88% and course-level grades about 0.24 points higher than expected based on the prior achievement."
Discussion¶
Related Claims¶
- EBT practice enactment is positively associated with residualized course grades (r = 0.316). — related
- EBT practice enactment is positively associated with residualized student learning on the BASIC assessment (r = 0.315). — related
- Three fidelity components—completing Apply It problems, following up on Time-Sensitive Interventions, and having Automated Messages on—differentiate classes with better-vs-poorer-than-expected grades. — related
- Schools in which chronic absenteeism decreased implemented phone calls, mentorship programs, and text messaging with moderate or high fidelity more frequently than schools in which it increased — related
- Instructors in their second or subsequent term using Lumen One made greater use of six of seven instructor-facing courseware components than first-term users. — related
- Productive failure, problem-solving before instruction, shows a measured benefit of about d = 0.36 rising to about 0.58 at high design fidelity (as reported) — related
- Implementation fidelity of the creative writing unit was high: absentee rates below about 3% and completion of crucial divergent-thinking and writing assignments between 88% and 94% — related
- Most instructors using adaptive courseware believed it improved student learning and would use it again — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
implementation-fidelity-grade-residuals |
title |
Meeting four or more implementation fidelity criteria is associated with course grades about 0.24 points higher than expected, a 0.58 grade-point swing versus meeting only two criteria. |
description |
Meeting four or more implementation fidelity criteria is associated with course grades about 0.24 points higher than expected, a 0.58 grade-point swing versus meeting only two criteria. |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-09 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — barbara-means-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.