Manual assessment tools have the largest body of validity evidence in laparoscopic cholecystectomy but show variable reliability and no links to patient outcomes¶

Claim · All claims
Evidence · 1 study (2 entries) · review r3 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q3 i? Manual observational tools (41 studies) are the most well-studied LC assessment instruments, with the largest body of evidence across multiple independent cohorts, but no study evaluated associations between assessment scores and patient outcomes. → Mainwaring Elizabeth M. A. 2026 q3 i? Manual-tool validity is uneven: internal structure evidence is heterogeneous, response-process evidence limited, and generalisability restricted by small, mostly elective uncomplicated populations. → Mainwaring Elizabeth M. A. 2026 (2)

Evidence¶

Mainwaring Elizabeth M. A. 2026¶

Mainwaring Elizabeth M. A., Guidozzi Nadia, James Jonnie P., Pantling Jai, Menon Nainika, Salem Riadh, Markar Sheraz R. (2026). Objective technical skills assessment in laparoscopic cholecystectomy: a systematic review of manual, kinematic, and AI-based tools. Surgical Endoscopy. https://doi.org/10.1007/s00464-026-13309-z

q3 · i? · review · r3

The review's narrative synthesis comparing the three assessment modalities reports that manual tools "are the most well-studied instruments, with the largest body of evidence across multiple independent cohorts"; kinematic and AI systems were predominantly single-centre developmental studies.

"Manual-assessment tools are the most well-studied instruments, with the largest body of evidence across multiple independent cohorts."

Mainwaring Elizabeth M. A. 2026 (2)¶

q3 · i? · review · r3

In the manual-tools synthesis section, the review reports that relations-to-other-variables evidence rested mainly on correlations with trainee level, and "No study evaluated associations between assessment scores and patient outcomes". The 41 manual studies spanned global rating scales, procedural-based tools, error-based scales, and one hybrid instrument.

"No study evaluated associations between assessment scores and patient outcomes, and consequential validity evidence was largely limited to speculation of potential positive effect on trainee progression."

Discussion¶

Kinematic assessment systems for laparoscopic cholecystectomy are weakly validated, restricted to small datasets, and capture only a narrow component of operative competence — related
No objective assessment tool for laparoscopic cholecystectomy demonstrates comprehensive validity across all Messick domains, so no gold standard exists — a broader claim this one bears on
Methodological quality of LC assessment-tool studies is moderate (MERSQI median 12.5) and outcomes rarely extend beyond performance-level measures — a broader claim this one bears on
AI-based assessment systems show strong internal performance and early real-time deployment for critical view of safety detection, but lack external validation and clinical impact evidence — related
Most identified assessment tools demonstrate construct or concurrent validity, but predictive validity is absent across tool categories — related

Page metadata

Field	Value
`status`	`review`
`generated`	by `process:wiki-ingest` on `2026-10-31`
`trust`	unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.