Blended Learning Improves Outcomes¶

Claim · All claims
Evidence · 2 studies · 2 quant-synthesis r2 · q3 · i1–i2 · n=23 contrasts
Currency · newest study 2013 · 1 of 2 entries checked against their sources (automated) · not reviewed by a person

Blended learning — instruction that combines face-to-face teaching with online learning activities — is widely claimed to produce better learning outcomes than fully face-to-face or fully online formats. This page concerns that comparative-outcome claim. One synthesis is recorded: Means et al. (2013), whose 23 blended-versus-face-to-face contrasts favoured blended instruction (g+ = 0.35) but confounded the blend with extra learning time and resources; no entry here compares blended with fully online instruction directly.

Subclaims¶

q3 i2 A meta-analysis of 23 controlled contrasts found that blended (online + face-to-face) instruction produced significantly better learning outcomes than face-to-face instruction alone, but the studies confounded the blend itself with extra learning time and instructional elements, so the effect cannot be attributed to the blended format per se. → Means et al. 2013

q3 i1 In the meta-analysis, the mean effect size for blended versus face-to-face contrasts (+0.35, p < .001) was larger than the mean effect size for purely online versus face-to-face contrasts (+0.14, p < .05). → Means 2009

Evidence¶

Means et al. 2013¶

Means, B., Toyama, Y., Murphy, R., & Bakia, M. (2013). The Effectiveness of Online and Blended Learning: A Meta-Analysis of the Empirical Literature. Teachers College Record: The Voice of Scholarship in Education, 115(3), 1–47. doi:10.1177/016146811311500307

q3 · meta-analysis of experimental and quasi-experimental studies (not pre-registered) · i2 · medium effect, g+=0.35, p<.0001 · n=23 contrasts · quant-synthesis · r?

A meta-analysis (part of a US Department of Education-commissioned review) synthesized studies published 1996–2008 comparing online or blended instruction with face-to-face instruction, mostly in higher education and professional training. Of the corpus, 23 independent contrasts specifically compared a blended condition (face-to-face instruction supplemented or partly replaced by online activities) against a face-to-face-only control; the mean effect size for these was g+ = +0.35 (p < .0001), significantly larger than the g+ = +0.14 found for purely-online-vs-face-to-face contrasts (Q = 4.98, p < .05). The authors caution that blended conditions in these studies typically also included additional learning time and instructional resources not given to the control condition, so the advantage cannot be cleanly attributed to the blended format itself rather than to these confounded extras.

Note on the citation: the fourth author is Marianne Bakia, as the ERIC record of the underlying report (ED505824) gives it; the Crossref record for this DOI misspells the surname as "Baki".

Means 2009¶

Means, Toyama, Murphy, Bakia, & Jones. (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. U.S. Department of Education. https://www.ed.gov/about/offices/list/opepd/ppss/reports.html

q3 · i1 · quant-synthesis · r2

Meta-analysis of 51 contrasts (28 purely online, 23 blended per the report's split). The blended category's mean effect size of +0.35 exceeded the purely online mean effect size of +0.14; the report notes many studies did not equate curriculum materials, pedagogy, or learning time across conditions.

"The mean effect size in studies comparing blended with face-to-face instruction was +0.35, p < .001. This effect size is larger than that for studies comparing purely online and purely face-to-face conditions, which had an average effect size of +0.14, p < .05."

Studies bearing on this claim¶

Does a blended course produce better learning outcomes than the same course taught in one mode? This table gathers the studies behind this claim and the 2 narrower claims that bear on it: 3 distinct studies (2 quant-synthesis, 1 review), q2–q3, 2 of 3 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

The comparison problem. The central difficulty in evaluating this claim is that "blended learning" is not a single treatment. Studies comparing blended formats against face-to-face or fully online formats typically vary multiple factors at once — instructional time, materials quality, opportunities for active learning [+S], and assessment design. When blended conditions outperform comparison conditions, it is often unclear whether the benefit comes from the blend itself or from the additional time-on-task and redesigned activities that accompany it. Any future evidence entries should record what the blended condition actually changed relative to the comparison.

Heterogeneity of designs. Blended implementations range from supplementary online resources attached to an unchanged lecture course, through flipped designs that relocate exposition online to free class time for practice, to fully redesigned courses built around online adaptive learning [+M] pathways. Effects should be expected to differ sharply across these models; a pooled average across them would be difficult to interpret.

Plausible mechanisms, unverified here. Candidate mechanisms include reallocating scarce face-to-face time to interaction and feedback, enabling self-paced review of expository content, and supporting assessment for learning [+S] through frequent low-stakes online checks. Each mechanism has independent support in the literature, but this page does not yet contain evidence tying them specifically to blended-format comparisons.

Self-regulation as a boundary condition. The online component of a blended design shifts more responsibility for pacing, attendance, and persistence onto learners. This makes the claim plausibly conditional on self-regulated learning ability: strong self-regulators may exploit self-paced online materials effectively, while weaker self-regulators may disengage or fall behind. Whether blended designs help weaker self-regulated learners or disproportionately disadvantage them is unresolved and should be treated as a key moderator in any future evidence entry.

Cognitive load considerations. The online component can either reduce or add extraneous load depending on design quality. Poorly structured online materials without cognitive load management may impose navigation and split-attention costs that offset any benefit of the blend; well-designed self-paced exposition can allow learners to control pace and revisit content, consistent with cognitive load theory.

Open questions. Key moderators still to be documented: learner self-regulation demands of the online component, instructor preparation and workload, discipline, and whether outcomes are measured immediately or on delayed retention.

Related Claims¶

• In a low-certainty meta-analysis of 44 studies with very high heterogeneity (I² = 98%), undergraduate health professional students in flipped classes score higher than those in traditional classes (SMD = 0.57) — the general claim this finding bears on, with the studies behind it

• For college students who can choose between online and in-person sections, taking a course online lowers grades both in that course and in future courses — the general claim this finding bears on, with the studies behind it

• Adaptive learning improves outcomes. — adaptive online components are a common mechanism proposed for blended designs

• Active learning improves exam performance. — freed-up face-to-face time in blended models is often spent on active learning
• Assessment for learning improves achievement. — frequent online low-stakes assessment is a frequent blended component
• Case-based learning improves exam performance. — an active in-class method blended models often aim to make room for
• Clear structure improves learning. — structure matters especially in the self-directed online portion of a blend
• Students prioritize teacher interaction for face-to-face learning but content interaction for online learning — related
• The ACE-HE measurement model of affective, behavioral, and cognitive engagement fits online/blended survey data well — related
• Learning Space Redesign Alone Insufficient — related
• Experimental-group students accessed the online course and learning activities more frequently (6.38 and 7.92) than control-group students (2.67 and 6.05) — related
• Before this trial, online credit recovery was widely used despite no rigorous evidence on its relative efficacy versus face-to-face courses — related
• Academic leaders rate blended learning outcomes more favorably than fully online outcomes, with more rating blended as superior than inferior to face-to-face — related
• In the narrative synthesis, blended and purely online conditions within a single study generally produced similar learning outcomes, and media elements such as video or online quizzes did not appear to influence learning. — related
• Students in online learning conditions performed better on average than those receiving face-to-face instruction (mean effect size +0.24, p < .01, across 51 contrasts). — related
• A systematic search found almost no rigorous studies contrasting online and face-to-face instruction for K–12 students: none with computable effect sizes through 2006, and only five meeting meta-analysis criteria through July 2008. — related
• Research has not yet identified blended learning implementation strategies that increase the likelihood of positive effects on students — reports the opposite
• Of 13 online learning practice variables examined, only use of a blended approach and expanded time on task significantly influenced effectiveness; the other 11 did not. — related
• Some blended learning interventions improve student outcomes, but whether a positive effect exists varies across interventions and domains of achievement — related
• Effect sizes were larger in studies where online and face-to-face conditions differed in curriculum materials and instructional approach (+0.42) than where curriculum and instruction were nearly identical (+0.20; Q = 5.40, p < .05). — related
• Studies in which online learners spent more time on task than face-to-face learners showed a greater benefit for online learning (+0.46 vs. +0.19; Q = 3.88, p < .05). — related