ChatGPT accuracy varies substantially across countries and specialties, from 73% on Italian to 22% on French examinations¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q2 i? ChatGPT showed the highest accuracy in Italian examinations (73%) and the lowest in French examinations (22%), highlighting variance across contexts. → Lesselroth Blake 2025

Evidence¶

Lesselroth Blake 2025¶

Lesselroth Blake, Riese Janik, Yang Zhichao, Jaleel Shahila, Shabbir Waqas, Jaleel Anila, Aziz Umair, Farid Ghulam, Zahid Bashir Muhammad, Mirza Tehmasp Rehman, Khizar Abbas Syed Mohammad, Aslam Shiraz, Sikander Rana Muhammad Hassaan. (2025). Evaluating the Potential and Accuracy of ChatGPT-3.5 and 4.0 in Medical Licensing and In-Training Examinations: Systematic Review and Meta-Analysis. JMIR Medical Education. https://doi.org/10.2196/68070

q2 · i? · quant-synthesis · r2

The review reports, citing a prior study, that GPT showed "the highest accuracy in Italian examinations (73% correct answers) and the lowest in French examinations (22% correct answers)".

"One of the studies demonstrated that GPT showed the highest accuracy in Italian examinations (73% correct answers) and the lowest in French examinations (22% correct answers) [1]."

Discussion¶

Related Claims¶

• Pooled LLM accuracy differs minimally by question source (71% for internal exams vs. 73% for public databases) — related
• Preservice educators rate generative AI highest for logistical support (time saving, clarity, organizing thought) and lowest for epistemic trust, accuracy and consistency — related
• Students rated ChatGPT highly for completing activities more quickly, among the highest-scoring survey items in both courses — related