The paper tests two previously unevaluated VAM model variations: teacher-year level average peer characteristics and demographic variation in the lagged-achievement relationship¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2016: tool and model accuracy changes quickly

Subclaims¶

q2 i? The paper tests two model variations not previously evaluated: replacing classroom average peer characteristics with teacher-year level averages, and allowing the relationship between current and lagged achievement scores to vary by student demographic characteristics, to determine whether they affect VAM estimates. → Matthew Johnson 2013

Evidence¶

Matthew Johnson 2013¶

Matthew Johnson, Stephen Lipscomb, Brian Gill. (2013). Sensitivity of Teacher Value-Added Estimates to Student and Peer Control Variables. Working Paper 25. Cambridge, MA: Mathematica Policy Research. https://www.mathematica.org/publications/sensitivity-of-teacher-valueadded-estimates-to-student-and-peer-control-variables

q2 · i? · associational · r?

The abstract describes the paper's novel model variations: substituting teacher-year level averages for classroom average peer characteristics, and demographic variation in the current-to-lagged achievement relationship. No outcome of these tests is printed on the page.

"It also tests two model variations not previously evaluated—replacing classroom average peer characteristics with teacher-year level averages, or allowing for variation in the relationship between current and lagged achievement scores based on student demographic characteristics—to determine whether they affect the VAM estimates."

Discussion¶

Related Claims¶

• Using the Colorado Growth Model in place of a value-added model depresses evaluation scores for teachers with more English language learner students — related
• Using the Colorado Growth Model in place of a value-added model increases evaluation scores for teachers of low-achieving students — related
• Teacher value-added estimates are highly correlated across model specifications that differ in student and peer control variables — related
• Replacing classroom peer characteristics with teacher-level averages and allowing demographics to influence the lagged-achievement relationship have smaller practical consequences than other specification choices — possibly the same claim (merge candidate)
• The working paper examines the sensitivity and precision of teacher value-added estimates under specifications differing in student-level, peer-level, and double-lagged achievement controls — related
• Mathematica developed and estimated VAMs for use in Phase 1 of the Pennsylvania evaluation pilot — related
• Most differences in evaluation scores between the Colorado Growth Model and value added are not related to the characteristics of students' teachers — related
• The Memphis value-added model estimates school effects on student performance while adjusting for mobility, demographics, and measurement error — related
• Academic and behavioral classroom factors, not student demographics, drive the effect of composition on evaluator ratings — related