An adaptive mastery testing strategy reduces test length by 30% to 81% while reaching the same mastery decision as the conventional test for 96% of trainees¶

Claim · All claims
Evidence · 1 study · design r? · q2
Currency · newest study 1980 · not yet checked against its sources · not reviewed by a person
Evidence quality · No study behind this claim is a peer-reviewed article with a DOI: it rests on an ERIC document (a report, conference paper or thesis). It is kept because 3 design pages cite it; treat it as a lead to check, not an established finding.

Subclaims¶

q2 i? Compared with a conventional mastery test in real-data simulation, the adaptive mastery testing strategy reduced average test length from 30% to 81% with modal reductions up to 92%, agreeing with the conventional decision for 96% of trainees. → Weiss 1980

Evidence¶

Weiss 1980¶

Weiss, David J. (1980). Final Report: Computerized Adaptive Performance Evaluation. https://eric.ed.gov/?id=ED187760

q2 · i? · design · r?

Real-data simulation in a military training environment (Research Report 79-5) comparing an ICC-based maximum-information adaptive mastery strategy with Bayesian scoring against a conventional mastery test. The report states it "reached the same decision as the conventional test for96% Of trainees."

"the adapive' mastery testing strategy reducedothe average testlength from30% to 81% over Al mastery decisions examined!, with modal lest length reductions up to 92%, vet it reached the same decision as the conventional test for96% Of trainees."

Discussion¶

Related Claims¶

• Criterion-referenced tests require empirically-based construct validation studies — the general claim this finding bears on, with the studies behind it
• An adaptive strategy combining intra-subtest item selection with inter-subtest branching halves achievement test battery length with no loss in measurement quality — related
• Adaptive testing yields more precise achievement-level estimates than conventional classroom tests while using fewer items — related
• Adaptive achievement tests achieve effectively higher validity than conventional tests by reaching equal validity with 25% to 35% fewer items — related
• Bayesian adaptive design benefits evaluators by allowing smaller and more informative studies — related
• Adaptive testing yields better measurement precision than a fixed-form test of the same length — related