Future psychiatry education technology studies should use active comparators, standardized assessment tools, and long-term follow-up¶

Strategy · All strategies
Evidence · 3 claims (3 for) · 1 study (1 review), q2 · 1 of 1 report an effect size · 3 claims rest on one study

Description¶

The review recommends that future research focus on large-scale, well-controlled studies comparing innovative technologies to active learning interventions, assessing long-term retention, and exploring cost-effectiveness and scalability. It specifically recommends validated assessment methods such as the Objective Structured Clinical Examination (OSCE) and Objective Structured Assessment of Technical Skills (OSATS), which "offer reliable and reproducible ways to evaluate clinical competence and procedural performance." It also calls for clear frameworks and detailed methodological design guidance to enhance the maturity of these technologies.

Design Implications¶

Context¶

Requirements¶

• Comparisons against active learning modalities rather than outdated or baseline methods
• Standardized assessment tools such as OSCE and OSATS for comparability

Constraints¶

• The current evidence base's methodological heterogeneity made meta-analysis impossible; publication bias may have favored positive results

Target Learners¶

• medical students
• psychiatry residents

Target Learning Goals¶

• psychiatric knowledge
• procedural skills
• diagnostic reasoning

Claims¶

• Technology-based interventions in psychiatry education mostly show positive short-term effects on knowledge, skills, confidence, and empathy, but evidence of sustained learning is inconsistent [+W]
• Virtual patient simulations show mixed effects: improved diagnostic accuracy in one trial, no advantage over video teaching in another, and short-lived knowledge gains [+W]
• Gamified mobile microlearning improved written exam scores but not global clinical performance assessments in psychiatry clerkship students [+W]

Related Strategies¶

• Rigorously compare PBL with traditional methods before broad PGME implementation, using larger samples, controls, and follow-up
• Future MBI trials for youth should use scaled-up definitive designs with active intervention controls and embedded mechanism measures
• Future research should use standardized validated outcome measures, longitudinal follow-up designs, and methods linking learner gains to patient-relevant outcomes
• Future active-learning research should use randomised controlled designs with larger samples and standardised outcome measures
• Future research should include long-term RCTs with adequate sample sizes, standardized outcome measures, and cost-effectiveness analyses
• Conduct large-scale, well-designed RCTs with multiple outcome indicators to evaluate new teaching methods
• Future simulation research should use rigorous designs, standardized tools, and transparent reporting
• Methodological recommendations for future clinical reasoning education studies: report effect sizes with confidence intervals, control confounders, use ITT analysis, and determine MCID
• Prioritise longitudinal research and cost analysis when evaluating digital clinical skills modalities
• Evaluate interactive, simulation-based, spaced and mobile forms of digital education for guideline adoption, reporting skills, behaviour, patient and cost outcomes
• Adopt better methodologies and validated tools for identifying long-term EBP competency retention and for measuring attitude change
• Design future resilience-intervention research as large pragmatic RCTs with sufficient follow-up and explicit resilience definitions

Examples¶

-

Key Sources¶

• Mokhtari Saba, Mokhtari Asieh, Shariat Seyed Vahid, Nazeri Astaneh Ali, Shalbafan Mohammadreza. (2026). Innovative technologies in psychiatry education: a systematic review. BMC Medical Education. https://doi.org/10.1186/s12909-026-09573-1