Criterion-referenced testing: tests deliberately constructed so scores tell what behaviors individuals can demonstrate¶

Theory · All theories
Evidence · 2 claims (2 for) · 1 study (1 theoretical), q1 · 0 of 1 report an effect size · 2 claims rest on one study

Description¶

The paper defines criterion-referenced testing as an approach whose tests are "deliberately constructed to give scores that tell what kinds of behavior individuals with those scores can demonstrate". It traces the term to Glaser, who combined a desired model of performance with a standard domain of content, and distinguishes this usage from criterion variables and cut-off criterion scores. The framework underpins the paper's discussion of absolute interpretation and mastery learning.

Design Implications¶

Context¶

Requirements¶

• Behavior classes defining achievement levels must be specified as clearly as possible before the test is constructed, with a representative sampling plan for test tasks.

Constraints¶

• The paper notes abuses where tests with vaguely defined domains and unspecified sampling plans are interpreted in an absolute sense.

Target Learners¶

• school and training students assessed for instructional decisions

Target Learning Objectives¶

• describing learner competence with respect to defined domains of tasks

Claims¶

• Criterion-referenced tests require empirically-based construct validation studies [+W]
• Statistical item selection that maximizes norm-referenced discrimination undermines criterion-referenced test definitions [+W]

Related Theories¶

• Criterion-referenced (mastery) testing as the advocated grading framework
• Criterion-referenced testing, as defined by Glaser, measures mastery of defined abilities rather than relative standing among test takers
• Three patterns of instructional adaptation to individual differences, each with distinct measurement requirements
• Criterion-referenced versus norm-referenced tests as two distinct assessment purposes

Examples¶

• Four characteristics inherent in criterion-referenced tests
• Balloons: A Concepts About Print Assessment

Key Sources¶

• Nitko, Anthony J. (1970). Criterion-Referenced Testing in the Context of Instruction. https://eric.ed.gov/?id=ED047010