Grade 3 students showed small positive but statistically non-significant CCU impacts across all three study years¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Grade 3 treatment students had higher CCU scores than control students in years 1 through 3, but none of the differences were statistically significant. → Jonathan Nakamoto 2015

Evidence¶

Jonathan Nakamoto 2015¶

Jonathan Nakamoto, Sandy Sobolew-Shubin, Martin Orland. (2015). The Beaverton School District Arts for Learning (A4L) Lessons Project, An Investing in Innovation (i3) Development Grant: Student Impact Findings from Years 1, 2, and 3. WestEd. https://eric.ed.gov/?id=ED560945

q3 · i? · causal · r2

Exploratory CCU analyses in 12 schools; Exhibit E-2 prints grade 3 effect sizes of 0.22, 0.24, and 0.14, none reaching significance at the Benjamini-Hochberg-adjusted thresholds. Only the test outcomes are printed, so impact is null.

"The students in grade 3 had higher scores than the control students in years 1 through 3 and, based on the effect sizes, the impacts would be considered small positive program impacts. However, none of the differences concerning grade 3 students were statistically significant."

Discussion¶

Related Claims¶

• Grade 4 students in treatment schools scored significantly higher than control students on the CCU Assessments in each of the three study years, with effect sizes from 0.30 to 0.36 — related
• Grade 5 students showed very small, non-significant CCU differences, indicating no reliable A4L impact at that grade level — related
• The A4L Lessons Project had no statistically significant impact on students' OAKS Reading/Literature achievement after one, two, or three years of participation — related
• The A4L impact on grade 4 CCU outcomes differed significantly by ELL status in years 1 and 2, with substantially larger effects for ELL students, but not in year 3 — related
• The A4L impact on grade 4 CCU outcomes did not differ significantly between free/reduced-price lunch and non-FRL students — related
• Impacts on concepts of print outcomes were negative and nonsignificant across the three studies measuring them — related