Adopt structured reporting standards for prescribing assessment research including reliability, validity, cut scores and costs¶

Strategy · All strategies
Evidence · 3 claims (2 for, 1 mixed) · 1 study (1 review), q3 · 0 of 1 report an effect size · 3 claims rest on one study

Description¶

The review recommends that published research on prescribing assessment clearly describe test development, format, size and delivery time, and consistently report reliability, sample size, cut score and standard-setting methods. It also recommends reporting validity approaches, delivery format and security for online tests, and at least an indication of time costs of assessment.

Design Implications¶

Context¶

Requirements¶

• Description of test development, format, size and delivery time
• Consistent reporting of reliability, sample size, cut score and standard-setting methods

Constraints¶

Target Learners¶

• Medical students
• Pharmacists
• Healthcare students

Target Learning Goals¶

• Prescribing competence

Claims¶

• Most published studies of prescribing competence assessment use multiple-choice formats, with scenario-based skills tests, short answer questions and calculations also common [~W]
• Predictive validity, cost, and differential attainment by demographics are not indicated in the prescribing assessment literature [+W]
• Written knowledge tests, OSCEs and situational judgement tests all show predictive validity for later clinical performance [+W]

Related Strategies¶

• Extend prescribing competence assessment research to professions other than medicine
• Tailor Angoff implementation to programme and assessment needs, using trained multi-disciplinary panels with consensus-building
• Adopt standardized, competency-based frameworks that align instructional content and assessment strategies with clearly defined clinical outcomes

Examples¶

-

Key Sources¶

• McLachlan JC, Auta A, Ajiboye A. (2025). Assessment and evaluation of prescribing competences: A systematic review and recommendations. British Journal of Clinical Pharmacology. https://doi.org/10.1111/bcp.16033