Most reviewed simulation studies demonstrated face and content validity, but few assessed construct or predictive validity¶

Claim · All claims
Evidence · 1 study · review r3 · q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q3 i? Among reviewed studies, the majority demonstrated face validity and content validity was commonly established, but only a limited number provided construct validity and very few assessed predictive validity. → Menna Grazia 2025

Evidence¶

Menna Grazia 2025¶

Menna Grazia, Riva Dora, Marino Salvatore, Garber Jocelyn, Gerritsen Jasper Kees Wim, Mattogno Pier Paolo, Young Jacob Stewart, Olivi Alessandro, Doglietto Francesco, Berger Mitchel Stuart, Della Pepa Giuseppe Maria. (2025). Simulation tools in neuro-oncological surgery: a scoping review of perioperative and training applications. Journal of Neuro-Oncology. https://doi.org/10.1007/s11060-025-04972-8

q3 · i? · review · r3

In the Discussion, the review reports that "the majority demonstrated face validity" and "Content validity was also commonly established", while construct validity was provided by only a limited number of studies and predictive validity by very few.

"Among the reviewed studies, the majority demonstrated face validity, meaning that the simulation tools were perceived as realistic and useful by surgeons and trainees. Content validity was also commonly established, as most tools were designed to address critical neurosurgical competencies, including anatomical navigation, tumor resection planning, and intraoperative decision-making."

Discussion¶

Related Claims¶

• AR simulators for tumor localization and intraoperative guidance were tested on small patient subsets, limiting generalizability — related
• Only two of the included studies demonstrated predictive validity of their metrics for live robotic hysterectomy performance. — related
• PLS simulator is the most commonly used pediatric MIS training model, with construct validity established for its pattern-cutting task — related
• Scoping review identified 51 studies of simulation in neuro-oncological surgery, with AR the most frequently studied technology (25 of 51 articles) — related
• The ORSIM bronchoscopy simulator shows the most comprehensive validation among fibreoptic simulators, with construct validity (experts outperforming novices) and predictive validity — a narrower finding that bears on this claim
• Validity evidence for data-driven assessment tools relies predominantly on construct validity, with 11 of 35 studies using unvalidated tools — related
• Evidence for transfer of simulation training to operating-room outcomes was sparse in neuro-oncological simulation research — related
• Reporting of the validity source consequences is largely absent from identified assessment studies — related
• Most identified assessment tools demonstrate construct or concurrent validity, but predictive validity is absent across tool categories — related