Redundant speech-gesture cooperation improves recall and social perception more than complementarity¶

Claim · All claims
Evidence · 1 study · review r2 · q3
Currency · newest study 2009 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Buisine and Martin (2007) found redundancy (duplicating information in speech and gesture) is better than complementarity for recall of verbal information, quality of presentation, and social perception of agents. → Woo 2009

Evidence¶

Woo 2009¶

Woo, H.L. (2009). Designing multimedia learning environments using animated pedagogical agents: factors and issues. Journal of Computer Assisted Learning, 25, 203-218. https://doi.org/10.1111/j.1365-2729.2008.00299.x

q3 · i? · review · r2

Review reports Buisine and Martin's (2007) comparison of two modes of speech-gesture cooperation in animated agents. Redundancy outperformed complementarity on the three named measures; the review notes this behaviour is uncommon in human communication. No effect sizes are printed.

"Buisine and Martin's study found that redundancy is better than complementarity in terms of improving recall in verbal information, quality of presentation, and social perception of the agents"

Discussion¶

Related Claims¶

• On-screen text that duplicates the narration of a diagram can hurt learning, but spoken–written redundancy is not harmful on average and helps over spoken-only presentation in some conditions — related
• Redundant on-screen text impairs learning when it competes with a visualization, though written text duplicating narration alone can help — related
• Verbal redundancy does not facilitate learning when materials include images or animation — related
• The spoken–written advantage over spoken-only presentation appears for system-paced but not learner-paced materials — related
• Nonsegmented spoken–written presentations show a larger advantage over spoken-only presentation than segmented ones — related
• Most agent characteristics, including nonverbal communication, motion, and voice, did not moderate the instructional effectiveness of pedagogical agents — reports the opposite
• APA presentations tend to overload the visual channel, especially with high element interactivity content — related
• Observing gestures aids recall more when gestures provide complementary rather than redundant information (review attributes this to Austin et al., 2018) — reports the opposite
• Observing gestures embedded in instruction aids learning, especially when gestures convey a different strategy than speech — reports the opposite
• Typical gestures are rated as more semantically related to accompanying speech than atypical gestures — related
• Culturally familiar emblematic gestures improve L2 speech perception and social evaluations, whereas unfamiliar emblems reduce them — related