Automated video metrics correlate with validated expert-based assessment tools¶
Claim · All claims
Evidence · 1 study · reviewr2·q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person · recheck by 2027: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? In five studies, metrics produced by automated video analysis correlated with validated expert-based assessment tools including OSATS, GEARS, OSACSS and a GEARS-validated rubric. → Dick L 2024
Evidence¶
Dick L 2024¶
Dick L, Boyle CP, Skipworth RJE, Smink DS, Tallentire VR, Yule S. (2024). Automated analysis of operative video in surgical training: scoping review. BJS Open. https://doi.org/10.1093/bjsopen/zrae124
q2 · i? · review · r2
Narrative synthesis across the included studies. The review reports five studies comparing automated metrics with expert-based tools and states that "All studies reported that the metrics produced from analysis correlated with the validated tool used"; no correlation coefficients are printed.
"In addition, five studies compared the metrics produced with an alternative assessment tool. These were based on expert assessment and included OSATS, Global Evaluative Assessment of Robotic Skills (GEARS), Objective Structured Assessment of Cataract Surgical Skill (OSACSS)"
Discussion¶
Related Claims¶
- Automated assessment marks show very strong positive correlation with expert tutor marks on search algorithm exercises — related
- Virtual reality simulator performance has limited correlation with intraoperative robotic hysterectomy performance. — related
- No included study applied automated video metrics longitudinally to training or assessed non-technical skills — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-10-31 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.