The Memphis value-added model estimates school effects on student performance while adjusting for mobility, demographics, and measurement error¶

Claim · All claims
Evidence · 1 study · associational r? · q1
Currency · newest study 2008 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2011: tool and model accuracy changes quickly

Subclaims¶

q1 i? The model estimates each school's effect on student performance across all tested grades and subjects while accounting for student mobility, observable demographic differences, and measurement error in test scores. → Kevin Booker 2008

Evidence¶

Kevin Booker 2008¶

Kevin Booker, Eric Isenberg. (2008). Measuring School Effectiveness in Memphis. Washington, DC: Mathematica Policy Research. https://www.mathematica.org/publications/measuring-school-effectiveness-in-memphis

q1 · i? · associational · r?

Descriptive statement from the report's abstract about the value-added model Mathematica developed for the Memphis City school district. The report states the model "estimates each school's effect on student performance across all tested grades and subjects." No empirical results or effect sizes are reported on this page.

"The model estimates each school's effect on student performance across all tested grades and subjects, accounting for student mobility, observable differences in student demographics, and measurement error in test scores."

Discussion¶

Related Claims¶

• The working paper examines the sensitivity and precision of teacher value-added estimates under specifications differing in student-level, peer-level, and double-lagged achievement controls — related
• Teacher value-added estimates are highly correlated across model specifications that differ in student and peer control variables — related
• A K-3 school-level growth measure was estimated and examined, with validity and precision concerns suggesting cautious use for accountability — related
• Value-added error rates apply to measuring both teacher and school performance in the upper elementary grades using student test score gain data — related
• Mathematica developed and estimated VAMs for use in Phase 1 of the Pennsylvania evaluation pilot — related
• Replacing classroom peer characteristics with teacher-level averages and allowing demographics to influence the lagged-achievement relationship have smaller practical consequences than other specification choices — related
• Successive cohort indicators are subject to false performance gains, and the paper assesses which school evaluation methods provide useful accountability information — related
• The paper tests two previously unevaluated VAM model variations: teacher-year level average peer characteristics and demographic variation in the lagged-achievement relationship — related
• Magnet schools across the studied cities show strong positive impact on students' performance growth compared to state averages — related
• Student growth modeling and teacher value-added modeling are complex due to non-random assignment, measurement error, multidimensionality, and covariates — a broader claim this one bears on