Independent impact evaluation by Mathematica Policy Research¶

Element · All elements
Evidence · no claims cited

Description¶

Impact estimates in the report were produced by an evaluation contractor separate from the program developers. The report states that "MPR, the evaluation study contractor, conducted independent evaluations of all the intervention programs that are included in the SACD study," that an MPR data collection team independently collected the evaluation data (except fidelity data, collected by the seven teams), and that "The developers/implementers of these interventions did not conduct the impact analyses that are summarized in this report."

Design Implications¶

Context¶

Requirements¶

• A contractor distinct from the intervention developers must conduct data collection (except fidelity) and all descriptive and impact analyses

Constraints¶

• Fidelity of implementation data were collected by the seven research teams rather than by the independent contractor

Target Learners¶

• elementary school children in treatment and control schools

Target Learning Goals¶

• unbiased estimation of program impacts on social and character development

Related Elements¶

• Teacher Incentive Fund (TIF) performance pay evaluation study design report
• Chicago TAP evaluation project (2006-2012), prepared for the Joyce Foundation
• SACD multiprogram evaluation of seven schoolwide programs

Examples¶

-

Key Sources¶

• Social and Character Development Research Consortium (2010). Efficacy of Schoolwide Programs to Promote Social and Character Development and Reduce Problem Behavior in Elementary School Children (NCER 2011-2001). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education. https://www.mathematica.org/publications/efficacy-of-schoolwide-programs-to-promote-social-and-character-development-and-reduce-problem-behavior-in-elementary-school-children