A six-station sport medicine OSCE showed high reliability and construct validity, with senior residents outscoring junior residents¶
Claim · All claims
Evidence · 1 study (2 entries) · reviewr2·q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person · recheck by 2027: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? The Dwyer SEM OSCE achieved an overall Cronbach alpha of 0.91 and discriminated among years of training. → El Sherif Reem 2024
q3 i? Senior residents scored consistently higher than junior residents, supporting construct validity. → El Sherif Reem 2024 (2)
Evidence¶
El Sherif Reem 2024¶
El Sherif Reem, Shrier Ian, Paul-Tellier Pierre, Rodriguez Charo. (2024). What do we know about Objective Structured Clinical Examination in Sport and Exercise Medicine? A scoping review. Canadian Medical Education Journal. https://doi.org/10.36834/cmej.77841
q3 · i? · review · r2
Quantitative descriptive study of orthopedic residents after a sports medicine rotation, reported via the review. It printed "an overall Cronbach alpha of 0.91"; no standardised effect size is printed.
"the authors developed and assessed the performance of a SEM OSCE, and reported an overall Cronbach alpha of 0.91 and the ability of the OSCE to discriminate among different years of training"
El Sherif Reem 2024 (2)¶
El Sherif Reem, Shrier Ian, Paul-Tellier Pierre, Rodriguez Charo. (2024). What do we know about Objective Structured Clinical Examination in Sport and Exercise Medicine? A scoping review. Canadian Medical Education Journal. https://doi.org/10.36834/cmej.77841
q3 · i? · review · r2
Follow-up study by the same author using the same OSCE with orthopedic residents. The review reports senior residents "consistently higher than junior residents"; the underlying study noted it was underpowered with possible examiner bias.
"One study reported that the OSCE scores of senior residents were consistently higher than junior residents: further confirming the construct validity of the OSCE in this setting."
Discussion¶
Related Claims¶
- Cronbach's alpha values for OSCE scores vary widely across studies, ranging from 0.43 to 0.93, with most studies not reaching good internal consistency — a broader claim this one bears on
- OSCE designs with 5-10 stations achieve good internal consistency (Cronbach's alpha = 0.83), outperforming designs with fewer than 5 or more than 10 stations — a broader claim this one bears on
- When OSCEs have 5-10 stations, duration per station under 10 minutes yields significantly better internal consistency (alpha = 0.88) than 10 or more minutes (alpha = 0.64) — related
- When station number varies widely, duration time per station is not a major factor affecting OSCE internal consistency — related
- Only a small fraction of published OSCE research in musculoskeletal and sport medicine was actually conducted in a Sport and Exercise Medicine setting — related
- Practising physical therapists outperformed physical therapy students on a single-station simulated OSCE, supporting known-groups construct validity — related
- Construct validity evidence shows statistically significant proficiency differences favouring junior over senior groups across modalities, though junior and senior residents did not differ on some metrics — reports the opposite
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.