Consult multiple evidence reviews and attend to their differing standards when synthesizing evidence for decisions¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Because reviews differ in how they assess elements such as attrition and in how they conceptualize effectiveness, decision makers synthesizing evidence across multiple program evaluations should attend to each review's goals and standards. The article notes "it can be difficult for decision makers to synthesize the body of evidence when faced with results from multiple program evaluations," making awareness of cross-review differences a practical step.

Design Implications¶

Context¶

Requirements¶

• Access to the goals and standards documents of the reviews being synthesized.

Constraints¶

• Differences in effectiveness conceptualization across reviews limit straightforward synthesis.

Target Learners¶

• Policy makers
• Practitioners

Target Learning Goals¶

• Using evidence reviews to select and implement evidence-based programs

Related Strategies¶

• Educational leaders should examine demographic shifts in the tested student population before making growth and recovery support decisions

Examples¶

-

Key Sources¶

• Westbrook, T'Pring R.; Avellar, Sarah A.; Seftor, Neil. (2017). Reviewing the Reviews: Examining Similarities and Differences Between Federally Funded Evidence Reviews. Evaluation Review, vol. 41, no. 3. https://www.mathematica.org/publications/reviewing-the-reviews-examining-similarities-and-differences-between-federally-funded-evidence. doi:10.1177/0193841x16666463