Multimodal Presentation¶

Strategy · All strategies
Evidence · 3 claims (3 for) · 11 studies (7 causal, 3 quant-synthesis, 1 review), q2–q4 · 3 of 11 report an effect size

Description¶

Multimodal presentation delivers content through two or more coordinated channels — most commonly spoken or written words combined with relevant images, diagrams, or animation. The goal is to engage both verbal and visual processing channels so learners can build integrated mental representations rather than translating words into images on their own.

Design Implications¶

Multimodal presentation rests on dual coding: information presented simultaneously in verbal and visual form can be processed in parallel by separate cognitive channels, producing richer representations than either modality alone Presenting information in both verbal and visual form improves recall. [+S]. The benefit is conditional, not automatic — the modalities must be coordinated and the visual must carry meaning. Decorative images that do not support the content add load without benefit Decorative illustrations do not improve learning. [+M], and poorly integrated media can overload working memory Cognitive overload degrades learning. [+S].

Context¶

Requirements¶

• Visuals that are relevant to the learning goal — diagrams, animations, or images that depict the content structure, not decoration
• Coordination between channels: narration and images presented simultaneously rather than sequentially (Contiguity)
• Management of total load: avoid presenting the same words as on-screen text and narration while showing complex visuals Cognitive overload degrades learning. [~S]
• Clear structure so learners know where to look and in what order (Clear Structure Presentation)

Constraints¶

• Redundancy penalty: narrating on-screen text verbatim while showing graphics typically hurts learning compared with narration alone [-S] — the visual channel is wasted re-processing words the auditory channel already carries
• Split attention: separating related information across space or time (e.g., a legend far from a diagram) forces costly integration and reduces benefit [-S]
• Overload risk with complex, fast-paced animation: learners cannot control pacing, so transient information disappears before it is processed [~S]
• For simple content already well understood, adding a second modality adds little and may distract [~M]

Implementation Variability¶

• Static vs. dynamic visuals: static diagrams often match or beat animation because learners can control pacing [~M]
• Narration vs. text: narration + graphics suits novices and complex content; text + graphics allows learner-paced reading
• Segmenting: breaking animation into learner-controlled segments restores pacing control and improves learning
• Signaling: cues (color, arrows, highlighting) direct attention to the relevant part of the visual

Target Learners¶

• Novices benefit most, because they lack the prior knowledge to generate their own mental imagery from words alone [+M]
• Learners with low spatial ability gain more from well-designed visuals, but are also most vulnerable to overload from complex animation [~M]
• Less beneficial for experts, who can construct representations from verbal description alone [~M]

Target Learning Goals¶

• Conceptual understanding of systems, processes, and spatial structures (circulation, weather, mechanisms)
• Recall of verbal content supported by imagery Presenting information in both verbal and visual form improves recall. [+S]
• Transfer to novel problems requiring an integrated mental model

Instructions¶

1. Identify the core content and ask what visual would depict its structure — if none exists, do not add one Decorative illustrations do not improve learning. [+M]
2. Choose narration for complex or transient content; choose on-screen text when learners must control pacing
3. Present words and visuals simultaneously and spatially integrated, using signaling to guide attention
4. Segment long animations and give learners control over pacing
5. Manage total load by applying Cognitive Load Management — eliminate redundancy, seductive details, and non-essential audio
6. Follow with Practice or retrieval to consolidate the integrated representation

Related Strategies¶

• Chunking — reduces within-modality load so the multimodal benefit is not swamped
• Activating Prior Knowledge — primes the schema that the visual and verbal channels will jointly update
• Select authentic texts with highly informative contextual cues matched to learner proficiency, and add multimodal glosses when context is insufficient

Examples¶

• Khan Academy — narrated diagrams and worked visuals synchronized with spoken explanation, applying modality and contiguity principles.
• PhET Interactive Simulations (https://phet.colorado.edu) — interactive visual models of physics phenomena paired with guided prompts; learners control pacing, mitigating the transience problem.
• Anatomy and physiology instruction — labeled diagrams with narration replacing text-heavy slides, consistent with Mayer's multimedia principles.

Key Sources¶

• Mayer, R. E. (2009). Multimedia Learning (2nd ed.). Cambridge University Press. doi:10.1017/CBO9780511811678
• Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. doi:10.1207/S15326985EP3801_6
• Ginns, P. (2006). Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction, 16(6), 511–525. doi:10.1016/j.learninstruc.2006.10.001
• Clark, R. C., & Mayer, R. E. (2016). E-Learning and the Science of Instruction (4th ed.). Wiley. doi:10.1002/9781119239086
• Paivio, A. (1990). Mental Representations: A Dual Coding Approach. Oxford University Press. doi:10.1093/acprof:oso/9780195066661.001.0001