Use test adaptation measures in operational settings to identify adaptation difficulties and suggest processes for improving adaptivity¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article recommends using its three adaptation measures as operational diagnostic tools: after a test form runs, compute the measures from examinee-level test information to locate where adaptation is weak and to guide improvement. The abstract states the measures can "identify difficulties with adaptation and to suggest processes for improving adaptivity." This is an implementable process for assessment teams maintaining adaptive test batteries.

Design Implications¶

Context¶

Requirements¶

• Access to examinee-level test information from the operational test
• The three adaptation measures must be computed for the test in question

Constraints¶

• Demonstrated so far on simulations of adaptive, multistage, and fixed form tests rather than documented operational deployments in the available text

Target Learners¶

• examinees taking adaptive, multistage, or fixed form tests

Target Learning Goals¶

• improving the adaptivity of assessments so they better match individual examinees

Affordances¶

• Three Test Adaptation Measures Optimal Test Information

Related Strategies¶

• Diagnostic Pre Assessment
• Use interventional queries to inform support decisions in adaptive assessment

Examples¶

-

Key Sources¶

• NWEA Research. (2020). Three measures of test adaptation based on optimal test information. Journal of Computerized Adaptive Testing 8(1), 1-19. https://www.nwea.org/research/publication/three-measures-of-test-adaptation-based-on-optimal-test-information/