Illustrate Through Multiple Media¶

Strategy · All strategies
Evidence · 3 claims (3 for) · 7 studies (4 causal, 2 review, 1 quant-synthesis), q2–q4 · 1 of 7 report an effect size · 1 claim rests on one study

Description¶

Illustrating through multiple media means presenting the same core content through complementary channels — diagrams and animations alongside narration or text, simulations alongside static graphics, video alongside worked demonstrations. The strategy is grounded in dual coding: combining verbal and visual representations gives learners two coordinated memory codes rather than one Media combinations affect recall and retention. [+M]. It is not about adding more media, but about selecting media whose affordances match the content — animation for dynamic processes, static diagrams for structure, simulation for manipulation.

Design Implications¶

Multimedia works when the combination reduces extraneous load and enables referential connections between words and pictures; it fails when channels compete or when media are decorative Pairing words and pictures in ways that manage working memory load improves learning. [+M]. Mayer's coherence, signaling, and redundancy principles are the operative design rules: exclude seductive but irrelevant detail, cue attention to essential content, and avoid narrating text that is displayed verbatim Clark, R. C., & Mayer, R. E. (2016) [+S].

Context¶

Requirements¶

• Content analysis identifying which concepts are structural (best as diagrams), dynamic (best as animation or video), or procedural (best as Demonstration)
• Narration or captions that integrate verbal and visual streams rather than duplicating them
• Segmented, learner-paced presentation so learners can process each medium before the next Chunking reduces working memory load. [+S]
• Media selected for explanatory fit: dynamic media for dynamic content, static diagrams when learners need to control inspection pace
• Coordination across formats — narration and graphics presented simultaneously and spatially integrated, not split across screens or sequential blocks
• Alignment with Clear Structure: each medium has a defined role in the explanation, with signaling (cues, highlighting) directing attention to the relevant content
• A follow-on activity where learners apply or generate with the concept (Practice)

Constraints¶

• Redundancy harms learning: simultaneous identical narration and on-screen text overloads visual working memory Clark, R. C., & Mayer, R. E. (2016) [-S]
• Decorative graphics and seductive details divert attention from essential content and depress retention [-M]
• High element interactivity content can exceed working memory when split across media that require integration (split-attention effect) [-S]
• The strategy does not work by matching a learner's preferred "learning style" — the learning-styles hypothesis is empirically unsupported Pashler, H., McDaniel, M., Rohrer, D., & Bjork, R. (2008) [X]
• Redundant media harm learning: on-screen text read aloud verbatim overloads the same channel and reduces retention compared with narration plus graphics [-S]
• Seductive but irrelevant details — decorative images, background music, interesting tangents — divert attention from essential content and depress learning [-S]
• Learners with low prior knowledge benefit from segmented, learner-paced media; continuous fast-paced video can overwhelm them [~M]
• Translating the same text into multiple formats without integration adds processing cost rather than value [-M]

Implementation Variability¶

• Static diagrams often outperform animation for complex systems because learners control pacing and can revisit [~M]
• Simulations shift the medium from presentation to manipulation; pair with prompts or they become play [~M]
• Video demonstrations can substitute for live modeling when narration makes reasoning explicit (Think-Aloud)
• Static-first: labeled diagrams with Advance Organizers before any video, letting learners build structure before processing dynamic content
• Simulation-based: interactive environments (e.g., PhET) where learners manipulate variables and observe outcomes, pairing illustration with guided inquiry
• Learner-generated media: students create their own diagrams, videos, or Analogies to explain a concept, converting illustration into a generative activity

Target Learners¶

• Novices, who benefit most from coordinated verbal–visual codes that reduce unguided search Media combinations affect recall and retention. [+M]
• Learners with low prior knowledge in the domain, for whom well-designed multimedia reduces cognitive load [~M]
• Less beneficial for experts, for whom redundant graphics can impose unnecessary integration costs [~M]
• Learners with limited domain vocabulary, for whom visuals carry meaning that dense text cannot (Accessible Vocabulary & Syntax)
• Less beneficial for high-knowledge learners, for whom detailed graphics can be redundant with their existing mental models [~M]

Target Learning Goals¶

• Conceptual understanding of structures, systems, and spatial relationships
• Procedural knowledge via narrated video or animated Demonstration
• Abstraction from varied representations — presenting contrasting cases across media supports generalization Multiple contrasting cases support abstraction. [+M]
• Conceptual understanding: building integrated verbal and pictorial models of systems and processes
• Transfer: contrasting representations and simulations support abstraction beyond the presented examples

Instructions¶

1. Identify the core concept and choose the medium that matches its structure (diagram, animation, simulation, video) rather than defaulting to text-plus-slides
2. Open with an Advance Organizer or brief orientation so learners know what to attend to in each medium
3. Present the concept through the primary medium with integrated narration, using Analogies to bridge to prior knowledge
4. Follow with Application or Practice in a different medium than the presentation, forcing learners to translate between representations
5. Use Assessment items that require learners to interpret or produce the visual representation, not just restate the narration

Related Strategies¶

• Worked examples — the multimedia version is a narrated video demonstration; same example–practice logic
• Case-based teaching — cases are frequently delivered through video and documents across media
• Flipped classroom — pre-class video is the most common multimedia illustration vehicle
• Use Worked Examples — worked examples are a media illustration of solution structure; multimedia design principles apply directly to their presentation
• Analogies and Prior Knowledge Activation — analogies are a verbal illustration device that pairs naturally with visual models
• Case-Based Learning — cases supply authentic contexts that multiple media can render vividly

Examples¶

• PhET Interactive Simulations (https://phet.colorado.edu) — research-validated science simulations paired with guided inquiry activities; studies show simulation-plus-guided-activity outperforms simulation alone [~M]
• Khan Academy (https://www.khanacademy.org) — narrated visual problem-solving videos followed by practice, enacting the presentation–practice sequence
• Anatomy & physiology courses using Netter's atlases with narrated labeling tasks — static visuals with learner-paced annotation rather than passive animation
• PhET Interactive Simulations — University of Colorado Boulder physics and chemistry simulations combining dynamic visuals with learner-controlled variables, widely validated for conceptual learning in science.
• Khan Academy — Narrated visual explanations paired with practice exercises; the drawing-plus-voiceover format follows modality and signaling principles.
• 3Blue1Brown — Mathematics explainer videos using animation to illustrate abstract structures, demonstrating animation's fit for dynamic and geometric content.
• Anatomy laboratory instruction — Combining 3D models (e.g., Visible Body), cadaver demonstration, and labeled diagrams so each representation contributes spatial information the others cannot.

Key Sources¶

• Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press. doi:10.1017/CBO9780511811678
• Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43–52. doi:10.1207/S15326985EP3801_6
• Clark, R. C., & Mayer, R. E. (2016). E-Learning and the Science of Instruction (4th ed.). Wiley. doi:10.1002/9781119239086
• Pashler, H., McDaniel, M., Rohrer, D., & Bjork, R. (2008). Learning styles: Concepts and evidence. Psychological Science in the Public Interest, 9(3), 105–119. doi:10.1111/j.1539-6053.2009.01038.x
• Paivio, A. (1990). Mental representations: A dual coding approach. Oxford University Press. doi:10.1093/acprof:oso/9780195066661.001.0001