Multiple mini-interviews significantly predict early clinical exams (d=0.417) and early academic results (d=0.195), while panel interviews show no significant predictive effects¶
Claim · All claims
Evidence · 1 study (2 entries) · quant-synthesisr2·q3·i2medium
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i2 MMI effect sizes were 0.417 for early program OSCE/OSLER/clinical exams and 0.195 for early program academic results, both statistically significant. → Huang Pin-Hsiang 2024
q3 i? Panel interview effect sizes for early and end of program academic results were smaller than 0.2 with 95% CIs intersecting zero. → Huang Pin-Hsiang 2024 (2)
Evidence¶
Huang Pin-Hsiang 2024¶
Huang Pin-Hsiang, Arianpoor Arash, Taylor Silas, Gonzales Jenzel, Shulruf Boaz. (2024). Insights into undergraduate medical student selection tools: a systematic review and meta-analysis. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2024.21.22
q3 · i2 · quant-synthesis · r2
Random-effects meta-analysis of MMI studies (9 articles, 12 effect sizes per Table 1), with printed pooled values d = 0.417 and d = 0.195. The abstract states "Panel interviews showed no significant effect"; panel CIs intersected zero for academic outcomes.
"The effect sizes of MMI’s were 0.417 (95% CI, 0.092 to 0.743) for early program OSCE/OSLER/clinical exams and 0.195 (95% CI, 0.019 to 0.372) for early program academic results."
Huang Pin-Hsiang 2024 (2)¶
Huang Pin-Hsiang, Arianpoor Arash, Taylor Silas, Gonzales Jenzel, Shulruf Boaz. (2024). Insights into undergraduate medical student selection tools: a systematic review and meta-analysis. Journal of Educational Evaluation for Health Professions. https://doi.org/10.3352/jeehp.2024.21.22
q3 · i? · quant-synthesis · r2
Random-effects meta-analysis of panel interview studies (12 articles, 20 effect sizes). No panel interview effect reached statistical significance; equivalence was not tested.
"Panel interviews had effect sizes smaller than 0.2 for early and end of program academic results, and an effect size of 0.372 for end of program OSCE/OSLER/clinical exams. However, these 3 effect sizes had 95% CIs intersecting zero."
Discussion¶
Related Claims¶
- Evidence on selection tools predicting dropout is scarce, with no tool showing a statistically significant effect on dropout — related
- Written knowledge tests, OSCEs and situational judgement tests all show predictive validity for later clinical performance — related
- Situational judgement tests show a statistically significant but negligible-magnitude effect on early program academic results (d=0.170), while personality test evidence was insufficient for meta-analysis — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.