GPT-4 exceeds pass marks on India NEET-PG and UK PLAB 1 but falls below pass on clinical reasoning and procedural items¶

Claim · All claims
Evidence · 1 study · review r3 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q3 i? In five NEET-PG studies GPT-4 averaged 74% accuracy (range 70–80%); across three PLAB studies it exceeded the PLAB 1 pass threshold (72–75%) but fell below equivalent pass marks for clinical communication and procedural reasoning items. → Bodke Parag 2026

Evidence¶

Bodke Parag 2026¶

Bodke Parag, Jumle Rahul. (2026). Large language models in undergraduate medical education: a systematic review of examination performance, knowledge acquisition, and learner perceptions. BMC Medical Education. https://doi.org/10.1186/s12909-026-09999-7

q3 · i? · review · r3

Narrative synthesis of five NEET-PG and three PLAB benchmark studies. The review reports "GPT-4 exceeded the PLAB 1 pass threshold in all studies (range: 72%–75%)" and mean NEET-PG accuracy of 74%, described as modestly lower than USMLE performance.

"Across three UK PLAB studies, GPT-4 exceeded the PLAB 1 pass threshold in all studies (range: 72%–75%) while falling below equivalent pass marks for clinical communication and procedural reasoning items"

Discussion¶

Related Claims¶

• GPT-4 examination accuracy is moderated by item type: multi-step vignettes (61–71%) and image-dependent items (48–63%) fall well below single-fact recall (83–88%) — related
• GPT-4 achieves passing accuracy on USMLE Steps 1–3 (mean 86%), significantly exceeding GPT-3.5 (mean 56%) — related
• LLMs, particularly GPT-4, can match or exceed medical students' examination performance — related
• In the combined review analysis, ChatGPT-3.5 failed eight of nine UK postgraduate exams while ChatGPT-4 passed nine of eleven — related