Too Good for Violence shows a substantively important but not statistically significant effect on students' knowledge, attitudes, and values¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · newest study 2006 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The study found no statistically significant impact on student protective factor survey total scores at 20-week follow-up, though the effect size met WWC criteria for substantive importance. → What Works Clearinghouse 2006

Evidence¶

What Works Clearinghouse 2006¶

What Works Clearinghouse. (2006). WWC Intervention Report: Too Good for Violence. U.S. Department of Education. https://www.mendezfoundation.org

q3 · i? · causal · r?

In the same randomized controlled trial, the student protective factor survey total scores showed "no statistically significant impacts" at 20-week follow-up, yet the effect size was large enough to be considered substantively important under WWC criteria.

"Although the study authors reported no statistically significant impacts on elementary school students’ total scores using the student protective factor survey 20 weeks after the end of the program, the effect size was large enough to be considered substantively important using WWC criteria."

Discussion¶

Related Claims¶

• The WWC rated Too Good for Drugs and Violence as having positive effects on knowledge, attitudes, and values, with a cross-study domain-average effect size of 0.42 — reports the opposite
• In the RCT, the average effect across knowledge, attitudes, and values outcomes was substantively important (0.35) but not statistically significant, with several individual outcomes null — related
• WWC improvement indices for Too Good for Violence are +18 percentile points for behavior and +16 for knowledge, attitudes, and values — related
• Too Good for Violence produces statistically significant positive effects on elementary students' behavior 20 weeks after the program ends — related
• The effect on SAT math scores was positive but not statistically significant, though large enough to be substantively important (effect size at least 0.25) — related
• The guide treats an effect size of +0.25 or higher as substantively important, equivalent to raising performance at least 10 percentile points — a broader claim this one bears on
• In a quasi-experimental study, Too Good for Drugs and Violence produced statistically significant effects on attitudes toward violence, emotional competence, social and resistance skills, and goals and decisionmaking — related
• Too Good for Drugs shows no discernible effects on student knowledge, attitudes, and values across two randomized controlled trials — related