Successive cohort indicators are subject to false performance gains, and the paper assesses which school evaluation methods provide useful accountability information¶

Claim · All claims
Evidence · 1 study · theoretical r? · q1
Currency · newest study 2011 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2014: tool and model accuracy changes quickly

Subclaims¶

q1 i? Successive cohort differences in achievement levels can yield false performance gains, and the paper assesses which test-score-based methods provide useful information for school accountability. → Glazerman 2011

Evidence¶

Glazerman 2011¶

Glazerman, Steven M., and Liz Potamites. (2011). False Performance Gains: A Critique of Successive Cohort Indicators. Working Paper 2. Washington, DC: Mathematica Policy Research. https://www.mathematica.org/publications/false-performance-gains-a-critique-of-successive-cohort-indicators

q1 · i? · theoretical · r?

The paper's stated purpose, per its abstract, is to assess which test-score-based school evaluation methods "provide useful information for school accountability and why." The title identifies the paper's central critique: successive cohort indicators can produce false performance gains. No empirical statistics are printed in the available text.

"The paper helps assess which methods provide useful information for school accountability and why."

Discussion¶

Related Claims¶

• The Teacher Team Method and Full Roster Method provide a more stable approach than the Partial Credit Method for estimating teacher effects when students have multiple teachers for the same subject. — related
• The working paper examines the sensitivity and precision of teacher value-added estimates under specifications differing in student-level, peer-level, and double-lagged achievement controls — related
• One- and two-parameter ICC scoring yields highly similar achievement estimates, while the three-parameter model reduces similarity, especially for adaptive test data — related
• TEP's achievement impacts were consistently positive across subjects and cohorts through 2012-2013, with especially large effects in math — related
• The Memphis value-added model estimates school effects on student performance while adjusting for mobility, demographics, and measurement error — related
• Standardized tests measure only part of what teachers expect students to learn and are not taken in all subjects — related
• Standardized test proficiency provides biased information about school quality, indicating a need for alternative metrics — related
• School effectiveness estimates from fall-to-spring versus spring-to-spring growth correlate only moderately to strongly (.399 to .705), below the .90 threshold at which rank orderings diverge in accountability — related