Prefer mixed reality with hand tracking over head-mounted-display controllers for gesture-simulation training¶

Strategy · All strategies
Evidence · 2 claims (1 for, 1 against) · 2 studies (2 review), q2 · 0 of 2 report an effect size · 2 claims rest on one study

Description¶

The review recommends developing mixed reality environments using hand tracking so students physically practice gestures, rather than using HMD controllers. It states it "would be better to establish an MR environment, using hand tracking and physically practicing the skills, rather than using the HMD controllers", reducing learner burden from unfamiliar environments and enabling experiences similar to reality.

Design Implications¶

Context¶

Requirements¶

• Access to MR hardware such as Microsoft HoloLens 2 to enable hand tracking

Constraints¶

• None of the 7 included studies used mixed reality, so this recommendation rests on the review's argument rather than on included evidence

Target Learners¶

• midwifery students
• nursing students

Target Learning Goals¶

• gesture and procedural skill simulation
• anxiety reduction during clinical training

Claims¶

• XR gesture-simulation interventions reduce anxiety in most included midwifery and nursing education studies [+W]
• Chan et al. found physical-controller VR examination has higher ease of use and lower cognitive load than hand-tracking gestures [-W]

Related Strategies¶

• Use immersive VR with virtual agents and eye-tracking to isolate and manipulate specific social factors (gaze, feedback, embodiment, multimodality) in L2 learning experiments
• Adopt emerging gesture-capture and telestration technologies to extend embodied anatomical teaching in dental education
• Virtual Reality Immersive Training
• Design virtual simulations with ease-of-use features, haptic technology, moderate immersion, and postscenario feedback

Examples¶

-

Key Sources¶

• Pérez de los Cobos Cintas C, Vuillerme N, Thomann G, Di Marco L. (2025). Effect of an Extended Reality Simulation Intervention on Midwifery Students' Anxiety: Systematic Review. JMIR Nursing. https://doi.org/10.2196/68984