Generative AI chatbots answer orthopaedic exam questions with moderate accuracy, below trainee performance¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? ChatGPT v3.5 answered approximately 45% of upper-extremity exam questions correctly, versus 51–76% for trainees. → Banskota Bibek 2025
Evidence¶
Banskota Bibek 2025¶
Banskota Bibek, Bhusal Rajan, Yadav Prkash Kumar, Banskota Ashok Kumar. (2025). Artificial intelligence in orthopaedic education, training and research: a systematic review. BMC Medical Education. https://doi.org/10.1186/s12909-025-08162-y
q2 · i? · review · r2
The review reports generative AI performance on orthopaedic board-style questions, noting ChatGPT v3.5 achieved approximately 45% accuracy compared with 51–76% for trainees, indicating clinical reasoning that lags behind human trainees.
"ChatGPT v3.5 answered only ~ 45% of upper-extremity exam questions correctly versus 51–76% for trainees"
Discussion¶
Related Claims¶
- General-purpose LLMs show accuracy and reliability limits, including hallucinations and task-specific accuracy below perfect, making them risky as expert advice sources — a broader claim this one bears on
- ChatGPT shows high success on open-ended general chemistry exam questions but lower accuracy at the university level, and unverified copying of its answers is a reported risk — related
- Only 40% of ChatGPT-generated dermatology board-style questions were applicable for exams — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.