Taxonomy of approaches to achievement/performance evaluation: norm-referenced, criterion-referenced, time-referenced, and stage-referenced¶

Theory · All theories
Evidence · no claims cited

Description¶

The project's literature review organized achievement measurement into approaches displayed in Figure 1: population- or norm-referenced measurement (individual's relative position to others based on traditional psychometric theory, with results differing across norming groups), content- or criterion-referenced measurement (reflecting proportion of correct responses, with an underdeveloped psychometric rationale), time-referenced measurement (reflecting performance as a function of time in training, requiring longitudinal measurement), and stage-referenced measurement (assignment to stage according to a superimposed stage theory, a special case of time-referenced). The report states "Figure 1summarizeS the several approaches to the-measurement, of achieve-nt4 or perforthance that were identified in the review of the 1iteratt4re" and that achievement measurement "was determined to be considerably more complex thantthe related problem of ability measurement." This taxonomy motivated redefining project objectives toward adaptive strategies for achievement's unique problems.

Design Implications¶

Context¶

Requirements¶

• Each approach requires its own psychometric rationale; the review found little rationale available for time-referenced and stage-referenced measurement

Constraints¶

• The review found norm-referenced results differ depending on the norming group, and classical test theory makes adaptive testing difficult because of the large item numbers required

Target Learners¶

• postsecondary students
• military trainees

Target Learning Objectives¶

• valid measurement of achievement and achievement gains in instructional domains

Claims¶

Related Theories¶

• Criterion-referenced versus norm-referenced tests as two distinct assessment purposes

Examples¶

-

Key Sources¶

• Weiss, David J. (1980). Final Report: Computerized Adaptive Performance Evaluation. https://eric.ed.gov/?id=ED187760