Use immersive VR with virtual agents and eye-tracking to isolate and manipulate specific social factors (gaze, feedback, embodiment, multimodality) in L2 learning experiments¶

Strategy · All strategies
Evidence · 7 claims (6 for, 1 mixed) · 3 studies (1 causal, 1 quant-synthesis, 1 review), q2–q3 · 2 of 3 report an effect size · 7 claims rest on one study

Description¶

The review recommends immersive head-mounted-display VR as a methodological bridge between ecological validity and experimental control for socially interactive L2 research. VR "allows for the full control of multimodal sensory stimulation (i.e., the onset, location, and duration of presentation of the stimuli)", lets researchers alter a virtual agent's speaking pace, accent, prosody, gaze and feedback valence while holding appearance constant, and enables precise measurement of eye, head, hand and body movements, gaze-following, facial emotion and physiological responses. The authors demonstrate feasibility with a gaze-manipulation word-learning study that would be very difficult to control with physically present actors.

Design Implications¶

Context¶

Requirements¶

• Experiments requiring complex behaviors such as negotiating meaning or corrective feedback should still use human actors, confederates or naive participants, since reproducing human cues in virtual agents remains challenging.

Constraints¶

• VR cannot replace real human interactions; EEG during HMD use requires participants to remain seated with limited movement to avoid artifacts; and inter-brain synchrony findings may partly reflect low-level perceptual mechanisms.

Target Learners¶

• Adult second language learners in laboratory and applied research settings

Target Learning Goals¶

• L2 word encoding, lexical-semantic integration, willingness to communicate, and motivation in socially interactive contexts

Affordances¶

• Social L2 Learning Model

Claims¶

• Reliable dynamic-video social feedback produces more widespread cortical activation, better positive/negative feedback differentiation, and greater impact on word learning than symbolic feedback [+W]
• Live direct social interaction during sign-language syntax learning produces native-like left inferior frontal gyrus activation that video viewing does not [+W]
• Interactive social learning of new word concepts improves behavioral accuracy compared with observing recorded social interaction, and seeing the teacher's face aids learning only in the observational condition [+W]
• Encoding L2 words by viewing videos of social situations engages more native-like neural responses than textual translation, and in a second study improved behavioral performance over non-social videos [+W]
• Referential gaze from a virtual teacher boosts L2 word-object mapping unconsciously in immersive VR, mirroring joint-attention mechanisms in first language acquisition [+W]
• VR behavioural measures (word gaze, assembly time, rotation) did not predict word learning outcomes [~W]
• In one meta-analysis, modality-effect studies using virtual reality head-mounted displays show larger effects than studies using computer screens or audio-tapes [+W]

Related Strategies¶

• Virtual Reality Immersive Training
• Virtual Embodiment
• Use interactive VR to study cognition under realistic, controlled boundary conditions
• Prefer mixed reality with hand tracking over head-mounted-display controllers for gesture-simulation training

Examples¶

-

Key Sources¶

• Ana Zappa, Mel Slater & Antoni Rodriguez-Fornells. (2025). Social interaction shapes and boosts second language learning: virtual reality can show us how. npj Science of Learning 10:90. https://doi.org/10.1038/s41539-025-00381-8