Taxonomy of seven TCSA models by interim blueprint design and score aggregation method¶

Theory · All theories
Evidence · 4 claims (3 for, 1 mixed) · 1 study (1 review), q2 · 0 of 1 report an effect size · 4 claims rest on one study

Description¶

The review organizes through-course summative assessment models along two axes: interim blueprint design (distributed vs. cumulative) and summative score aggregation method (simple vs. complex). It states that "Table 2.1 presents a matrix of seven models found in the literature based on combinations of blueprint designs and aggregation methods." Distributed blueprints divide "the summative blueprint...into mutually exclusive parts where each part is assigned to an interim time period," while cumulative blueprints measure all content taught to date. Complex aggregation uses latent trait or IRT/MIRT models.

Design Implications¶

Context¶

Requirements¶

• A TCSA model must answer how interim blueprints ensure full-domain coverage by year end and what aggregation method combines scores

Constraints¶

• None of the reviewed TCSAs described a comprehensive blueprint approach that samples the summative blueprint at each test event

Target Learners¶

• K-12 students in state accountability systems

Target Learning Objectives¶

• Measuring grade-level standards proficiency and academic growth for accountability

Claims¶

• Distributed blueprints with differing district pacing guides risk testing students on content they had no opportunity to learn [+W]
• The TCSA literature is sparse, with very few empirical or quantitative studies of the models' measurement properties [~W]
• Simple addition of through-course results is appropriate only when learning is bounded to each testing period [+W]
• Wise's simulation under continuous learning recommended projection-based weighted averages for aggregating interim scores [+W]

Related Theories¶

Examples¶

-

Key Sources¶

• Garron Gianopulos. (2019). From Through-Course Summative to Adaptive Through-Year Models for Large-scale Assessment: A Literature Review. NWEA. https://www.nwea.org/research/publication/from-through-course-summative-to-adaptive-through-year-models-for-large-scale-assessment-a-literature-review/