Validity evidence for data-driven assessment tools relies predominantly on construct validity, with 11 of 35 studies using unvalidated tools¶
Claim · All claims
Evidence · 1 study (2 entries) · reviewr3·q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Of the 35 included studies, 24 reported tools with previously established validity evidence (55 references), while 11 (31%) used unvalidated tools. → Hardon Sem F. 2025
Evidence¶
Hardon Sem F. 2025¶
Hardon Sem F., Horeman Tim, Reijers Sophie J. M., Schoonmade Linda J., Daams Freek, van der Peet Donald L. (2025). The Implementation of Data-Driven Assessment into Laparoscopic Skills Training: A Systematic Review. Surgical Innovation. https://doi.org/10.1177/15533506251336824
q3 · i? · review · r3
The review's validity evidence analysis reports "Eleven (31%) studies used a data-driven assessment tool that was not validated" while the remaining 24 reported previously established validity evidence with 55 references.
"Eleven (31%) studies used a data-driven assessment tool that was not validated. The remaining 24 studies reported on assessment tools with previously established validity evidence, with a total of 55 references to the literature (Figure 5)."
Hardon Sem F. 2025 (2)¶
Hardon Sem F., Horeman Tim, Reijers Sophie J. M., Schoonmade Linda J., Daams Freek, van der Peet Donald L. (2025). The Implementation of Data-Driven Assessment into Laparoscopic Skills Training: A Systematic Review. Surgical Innovation. https://doi.org/10.1177/15533506251336824
q3 · i? · review · r3
Among the 24 studies with validity evidence, the review reports "construct validity (25 papers), content validity (16 papers), face validity (7 papers), and the remaining papers reported on a form of criterion validity."
"These studies reported on construct validity (25 papers), content validity (16 papers), face validity (7 papers), and the remaining papers reported on a form of criterion validity (eg, concurrent validity) (7 papers)."
Discussion¶
Related Claims¶
- A total of 2618 surgical residents were trained and assessed using data-driven assessment tools across the 35 included studies — related
- Only 35 of 2814 identified studies describe data-driven assessment tools implemented in laparoscopic skills training curricula for surgical residents — related
- The majority of published RCR education evaluations use measures without reported validation evidence — related
- Scenario-based tutor lessons produced a significant pooled 7.4% learning gain, driven by three lessons with established construct validity while three newer lessons showed no significant gains — related
- Most reviewed simulation studies demonstrated face and content validity, but few assessed construct or predictive validity — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.