AI-SSP clinical case development remained largely human-authored, with AI used mainly for interaction and scoring rather than case generation¶
Claim · All claims
Evidence · 1 study · reviewr3·q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Fourteen of 21 studies (67%) reported cases authored, adapted, or reviewed by clinical experts, faculty, residents, or other domain specialists, and only one study (5%) described cases developed by an LLM. → Zhang Wenjia (Stella) 2026
Evidence¶
Zhang Wenjia (Stella) 2026¶
Zhang Wenjia (Stella), Daniels Benjamin B, Mita Carol, Nguyen Hoang, Duong David B. (2026). AI for Clinical Competency Assessment: Scoping Review of Methods and Applications. JMIR Medical Education. https://doi.org/10.2196/92826
q3 · i? · review · r3
Review synthesis of scenario development approaches charted across the 21 included studies. The review states that "Fourteen (67%) studies reported cases that were authored, adapted, or reviewed by clinical experts, faculty, residents, or other domain specialists", with human expertise informing scenario writing, checklist design, NLP rules, and chatbot response logic; only one study described LLM-generated cases.
"Fourteen (67%) studies reported cases that were authored, adapted, or reviewed by clinical experts, faculty, residents, or other domain specialists"
Discussion¶
Related Claims¶
- The evidence base for AI-SSP assessment remained concentrated in pilot, feasibility, proof-of-concept, and validation work, with only 10% of studies providing evidence beyond initial development or short-term evaluation — related
- AI-SSP backend architectures shifted from rule-based or NLP systems before 2022 to LLM-based systems in all studies published after 2022 — related
- History-taking was the most frequently assessed competency in AI-SSP studies (52%), and assessed domains shifted over time toward interactional competencies — related
- Twenty-one studies describing 20 unique AI-SSP systems for clinical competency assessment were published between 2008 and 2026, with 71% published in 2024 or later — a broader claim this one bears on
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.