Integrate validated data-driven assessment tools early in surgical training and maintain use throughout residency with pre-course benchmarks and immediate feedback¶

Strategy · All strategies
Evidence · 3 claims (2 for, 1 mixed) · 1 study (1 review), q3 · 0 of 1 report an effect size · 3 claims rest on one study

Description¶

The review recommends integrating "validated assessment tools early in surgical training and maintain their use throughout residency, fellowship, and advanced procedure training, supporting lifelong learning and development principles." Pre-course metric benchmarks or training goals can be set based on experience level, and immediate feedback enables trainees and trainers to identify improvement areas. This aligns with deliberate practice principles, optimizing learning curves by targeting specific technical skills for competency.

Design Implications¶

Context¶

Requirements¶

• Validated assessment tools with established validity evidence
• Direct feedback mechanisms for trainees and trainers

Constraints¶

• Program directors and surgical trainers should collaborate to establish consistent regulations and standards to prevent wasteful spending through excessive development without curricular integration

Target Learners¶

• Surgical residents
• Program directors
• Surgical trainers

Target Learning Goals¶

• Laparoscopic technical skills
• Deliberate practice
• Lifelong learning

Claims¶

• A total of 2618 surgical residents were trained and assessed using data-driven assessment tools across the 35 included studies [+W]
• Only 35 of 2814 identified studies describe data-driven assessment tools implemented in laparoscopic skills training curricula for surgical residents [+W]
• Validity evidence for data-driven assessment tools relies predominantly on construct validity, with 11 of 35 studies using unvalidated tools [~W]

Related Strategies¶

• Prioritize predictive-validity research, benchmarking of existing tools, and integration of kinematic data and AI in surgical skill assessment

Examples¶

-

Key Sources¶

• Hardon Sem F., Horeman Tim, Reijers Sophie J. M., Schoonmade Linda J., Daams Freek, van der Peet Donald L. (2025). The Implementation of Data-Driven Assessment into Laparoscopic Skills Training: A Systematic Review. Surgical Innovation. https://doi.org/10.1177/15533506251336824