A systematic search found almost no rigorous studies contrasting online and face-to-face instruction for K–12 students: none with computable effect sizes through 2006, and only five meeting meta-analysis criteria through July 2008.¶
Claim · All claims
Evidence · 1 study · quant-synthesisr2·q3
Currency · newest study 2009 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? An extensive systematic search of literature from 1994 through 2006 found no experimental or controlled quasi-experimental K–12 studies comparing online versus face-to-face instruction with sufficient data to compute an effect size; a subsequent search through July 2008 identified just five published studies meeting meta-analysis criteria. → Means 2009
Evidence¶
Means 2009¶
Means, Toyama, Murphy, Bakia, & Jones. (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. U.S. Department of Education. https://www.ed.gov/about/offices/list/opepd/ppss/reports.html
q3 · i? · quant-synthesis · r2
Systematic literature search across education, career technical, medical, higher education, corporate and military training literatures; 1,132 abstracts screened, 176 rigorous studies identified, of which just nine involved K–12 learners. The report states a subsequent search through July 2008 identified just five published studies meeting meta-analysis criteria.
"A systematic search of the research literature from 1994 through 2006 found no experimental or controlled quasi-experimental studies comparing the learning effects of online versus face-to-face instruction for K–12 students that provide sufficient data to compute an effect size."
Discussion¶
Related Claims¶
- Students in online learning conditions performed better on average than those receiving face-to-face instruction (mean effect size +0.24, p < .01, across 51 contrasts). — related
- Lack of standardised AI reporting undermines reproducibility, peer review, meta-analysis, and impact — related
- In the narrative synthesis, blended and purely online conditions within a single study generally produced similar learning outcomes, and media elements such as video or online quizzes did not appear to influence learning. — related
- Effect sizes were larger in studies where online and face-to-face conditions differed in curriculum materials and instructional approach (+0.42) than where curriculum and instruction were nearly identical (+0.20; Q = 5.40, p < .05). — related
- Blended Learning Improves Outcomes — related
- Online learning effectiveness was broadly positive across content areas and learner types, but the mean effect was not significant for the seven K–12 contrasts and the learner-type moderator test was nonsignificant. — related
- No rigorous evaluations of trauma-informed approaches in schools met inclusion criteria in a comprehensive systematic review search — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
few-rigorous-k12-online-studies |
title |
A systematic search found almost no rigorous studies contrasting online and face-to-face instruction for K–12 students: none with computable effect sizes through 2006, and only five meeting meta-analysis criteria through July 2008. |
description |
A systematic search found almost no rigorous studies contrasting online and face-to-face instruction for K–12 students: none with computable effect sizes through 2006, and only five meeting meta-analysis criteria thro... |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2009 |
generated |
by process:wiki-ingest on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — means-2009 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.