Metaverse-based clinical assessment platforms augmented by LLMs offer a promising complementary approach to conventional OSCEs¶
Design · All designs
Evidence · 5 claims (4 for, 1 mixed) · 3 studies (2 review, 1 design),q2· 0 of 3 report an effect size · 5 claims rest on one study
Description¶
The article proposes a framework in which metaverse environments with LLM-driven virtual patients serve as a complementary assessment tool rather than a replacement for OSCEs. It is grounded in expert consensus that conventional OSCEs face structural constraints including examiner variability, resource demands, and limited scenario diversity. The framework positions metaverse simulation as addressing standardization, scalability, and reproducibility gaps while retaining in-person formats for tactile and affective competencies.
Design Implications¶
Context¶
Requirements¶
- Requires integration of LLMs with predefined, expert-reviewed case data to ensure clinical accuracy and scenario consistency
- Requires high-performance computing equipment and stable internet connections
Constraints¶
- Cannot replicate procedures requiring tactile or haptic feedback such as palpation and percussion
- Emotional expressiveness of avatar patients is limited, reducing realism in empathy-focused encounters
- Study was exploratory and did not establish educational efficacy, validity, or feasibility in summative high-stakes contexts
Target Learners¶
- undergraduate medical students
Learning Goals¶
- clinical competence assessment
- communication skills
- diagnostic reasoning
Claims¶
- The metaverse environment enables delivery of consistent and reproducible scenarios supporting objective assessment of communication and diagnostic reasoning skills [+W]
- Four clinical scenario types were identified as suitable for metaverse-based assessment based on expert consensus criteria [+W]
- LLM integration into virtual patient scenarios enables realistic, context-sensitive medical interviews in a metaverse environment [+W]
- Controlled GenAI virtual-patient and communication studies reported short-term skill gains, but positive findings were not universal [~W]
- VR/AR and metaverse-based approaches were more frequently associated with favorable findings than screen-based virtual patient approaches, which yielded mixed findings with no clear advantage over non-technology-based simulation [+W]
Related Designs¶
Examples¶
-
Key Sources¶
- Huh Yeon-Ju, Shin Joon Sung, Yoon Narae, Kim Ju Whi, Kim Do Hoon, Kim Chanwoong, Jeong Seoi, Yoon Yejin, Shin Soyeon, Kong Hyoun-Joong, Myung Sun Jung. (2026). Metaverse-based objective structured clinical examinations: an exploratory approach to advancing clinical competency assessment. Korean Journal of Medical Education. https://doi.org/10.3946/kjme.2025.151
Page metadata
| Field | Value |
|---|---|
type |
design |
id |
metaverse-llm-osce-complementary-framework |
title |
Metaverse-based clinical assessment platforms augmented by LLMs offer a promising complementary approach to conventional OSCEs |
description |
The article proposes a framework in which metaverse environments with LLM-driven virtual patients serve as a complementary assessment tool rather than a replacement for OSCEs. |
status |
review |
generated |
by process:settle-candidates on 2026-11-04 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — huh-yeon-ju-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.