Select a DC estimation method based on score distribution shape, the user's measurement background, and the intended audience¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article provides guidelines for choosing among LL-DC, PS-DC, and W-DC depending on data distribution and audience. For reporting without explanation to non-measurement audiences, LL-DC suffices; for explaining the method in layman terms, the simpler W-DC or PS-DC is preferred, with PS-DC not recommended for skewed datasets. The article states: "if the goal is for a non- measurement professional to compute the DC estimate for a set of exam scores, then the W-DC method is recommended." Users may also compute and report multiple DC estimates for more confidence.

Design Implications¶

Context¶

Requirements¶

• Knowledge of the score distribution shape (skewed vs. normal), the user's measurement background, and whether the method must be explained to a non-measurement audience

Constraints¶

• PS-DC is not recommended for skewed datasets; W-DC may show small dips and peaks reflecting the observed score frequency distribution; the study did not evaluate method accuracy

Target Learners¶

• measurement professionals
• program directors
• classroom educators and other non-measurement professionals

Target Learning Goals¶

• choosing and computing an appropriate decision consistency estimate for a pass/fail exam

Affordances¶

• Ctt Decision Consistency Methods Taxonomy

Related Strategies¶

Examples¶

-

Key Sources¶

• Wolkowitz, A. A., & Smith, R. (2024). A Practical Comparison of Decision Consistency Estimates. Practical Assessment, Research & Evaluation, 29(6). https://pareonline.net/getvn.asp?v=29&n=6