Dual Coding¶

Strategy · All strategies
Evidence · 6 claims (5 for, 1 against) · 14 studies (7 causal, 4 quant-synthesis, 2 review, 1 theoretical), q2–q4 · 5 of 14 report an effect size · 1 claim rests on one study

Description¶

Dual coding pairs verbal information (words, narration, text) with a complementary visual representation (diagram, animation, image, graph) so that content is processed through both the verbal and visual channels of working memory. The two representations are not redundant — each carries part of the meaning — and learners benefit most when they actively integrate the two into a single coherent mental model. The strategy draws on Paivio's dual coding theory and Mayer's multimedia learning research.

Design Implications¶

Combining words and pictures consistently outperforms words alone for transfer and retention, provided the two are integrated rather than split Words and pictures presented together produce better learning than words alone. [+S]. The visual must be relevant to the verbal message: decorative images that do not carry meaning add load without adding learning Irrelevant graphics and text reduce learning by consuming working memory. [+S]. Integration is not automatic — learners need cues, proximity, and sometimes explicit prompts to connect the verbal and visual channels, and overloaded visuals can degrade learning just as overloaded text can Cognitive overload degrades learning. [+S].

Context¶

Requirements¶

• A visual that genuinely represents the content structure (process diagram, concept map, annotated image), not decoration
• Spatial and temporal contiguity: labels near the relevant visual parts; narration synchronized with animation (Cognitive Load Management)
• Learner activity that forces integration — labeling, self-explaining, or drawing — rather than passive viewing
• Text and narration managed so they do not compete for the same channel (avoid simultaneous on-screen text plus identical narration)

Constraints¶

• Redundant presentation — identical text spoken aloud and shown on screen — impairs learning compared with narration plus image Redundant on-screen text with narration impairs learning. [-S]
• Decorative or seductive visuals unrelated to the learning goal reduce retention and transfer Irrelevant graphics and text reduce learning by consuming working memory. [-S]
• Splitting related information across space or time (e.g., a legend far from a chart) forces costly visual search and reduces learning Integrated presentation beats split-attention presentation. [+M]
• Complex, high-element-interactivity content can overload the visual channel; Chunking and segmenting the visual into steps is required Chunking reduces working memory load. [+S]

Implementation Variability¶

• Static diagrams vs. animation: animation is not uniformly better; simple statics with learner pacing often match or beat animation [~M]
• Learner-generated visuals: having students draw or complete diagrams (drawing effect, Concept Mapping) produces strong gains but requires scaffolding for novices
• Text-first vs. image-first sequencing: for unfamiliar learners, a brief advance visual organizer before the verbal explanation helps (Advance Organizers)

Target Learners¶

• Novices benefit most, because pictures supply a missing mental model that words alone cannot build quickly Words and pictures presented together produce better learning than words alone. [+S]
• Low prior-knowledge learners gain more from well-designed multimedia; high-knowledge learners may not need the picture and can find it redundant [~M]
• Learners with strong spatial ability extract more from visuals; those with weak spatial ability need simpler, segmented graphics

Target Learning Goals¶

• Conceptual understanding: building structural mental models of systems, processes, and relationships
• Retention: two memory traces (verbal + visual) give two retrieval routes
• Transfer: integrated verbal-visual models support applying knowledge to new situations

Instructions¶

1. Identify the core structure of the content (sequence, hierarchy, causality, parts-whole) and choose a visual type that matches it.
2. Write or script the verbal explanation, then strip any words the visual already conveys (Cognitive Load Management).
3. Integrate words and picture: place labels adjacent to the relevant visual elements; narrate in sync with any animation.
4. Add integration prompts — ask learners to label a diagram, complete a partially drawn one, or self-explain the connection between image and text (Annotating).
5. Remove all decorative imagery and background music that does not serve the objective.
6. Check for redundancy: if narrating, do not display the full narration text on screen.

Related Strategies¶

• Worked Examples — worked examples typically pair solution steps (verbal) with annotated problem states (visual), enacting dual coding
• Chunking — manages the visual-channel load that complex diagrams can create
• Advance Organizers — a visual organizer presented before verbal content primes integration

Examples¶

• Khan Academy — narrated problem solving on a shared visual workspace; the writing appears as it is spoken, maintaining temporal contiguity.
• PhET Interactive Simulations (https://phet.colorado.edu) — science simulations pairing dynamic visuals with minimal on-screen text; students manipulate the visual model while the verbal explanation is delivered separately.
• Anatomy and physiology instruction — labeled anatomical diagrams with narration replacing paragraph-length text descriptions, a standard application in medical education multimedia.

Key Sources¶

• Paivio, A. (1990). Mental representations: A dual coding approach. Oxford University Press. doi:10.1093/acprof:oso/9780195066661.001.0001
• Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32(1), 1–19. doi:10.1207/s15326985ep3201_1
• Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge University Press. doi:10.1017/CBO9780511811678
• Clark, R. C., & Mayer, R. E. (2016). E-Learning and the Science of Instruction (4th ed.). Wiley. doi:10.1002/9781119239086