MedGame Bench¶
Product or Programme · All products and programmes
Evidence · 3 claims (2 for, 1 mixed) · 1 study (1 design),q2· 0 of 1 report an effect size · 3 claims rest on one study
Description¶
A 5,000-case medical narrative-generation and story-direction benchmark created by Qian Wu et al. from the PMC-Patients Dataset for evaluating medical AI systems.
Components¶
Claims¶
- Task-specific fine-tuning substantially improves open-source LLMs on MedGame Bench and narrows the gap with commercial models [+M]
- Without fine-tuning, commercial frontier models outperform open-source LLMs on MedGame Bench structural validity and content metrics [+M]
- Related-case overlap between MedGame Bench train and test splits shows no significant performance difference [~M]
Related Products and Programmes¶
-
Key Sources¶
- Qian Wu, Xinrong Zhou, Zizhan Ma, Kai Chen, Zheyao Gao, Xun Lin, Hongqiu Wu, Longfei Gou, Yixiao Liu, Ann Sin Nga Lau, Qi Dou. (2026). MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education. arXiv preprint. https://arxiv.org/abs/2607.21570
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
medgame-bench |
title |
MedGame Bench |
description |
A 5,000-case medical narrative-generation and story-direction benchmark created by Qian Wu et al. |
status |
review |
product_kind |
dataset |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.