TEEMSS produced a statistically significant positive effect on the grade 3–4 sound unit test in a quasi-experimental study¶

Claim · All claims
Evidence · 2 studies · 2 causal r2 · q2 · i2 medium
Currency · newest study 2012 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i2 Students taught the TEEMSS sound unit scored significantly higher than comparison students taught the same topic with regular methods (effect size 0.65, improvement index +24, p = 0.03). → sound-test-1 (2)

Evidence¶

sound-test-1¶

U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2012, May). Science intervention report: Technology Enhanced Elementary and Middle School Science (TEEMSS). Retrieved from https://ies.ed.gov/ncee/wwc/InterventionReport/610.

q2 · i2 · causal · r2

WWC review of a quasi-experimental study in which the same teachers taught the TEEMSS sound unit to the 2005–06 treatment group (97 students) and regular methods to the prior-year comparison group (84 students). The WWC-calculated effect size was 0.65 with improvement index +24 and p-value 0.03; intervention posttest mean was 14.78 (3.38) versus 12.81 (2.56).

"Zucker et al. (2008) reported, and the WWC confirmed, statistically significant positive effects on the TEEMSS sound unit test for students in grades 3–4."

sound-test-1 (2)¶

U.S. Department of Education, Institute of Education Sciences, What Works Clearinghouse. (2012, May). Science intervention report: Technology Enhanced Elementary and Middle School Science (TEEMSS). Retrieved from https://ies.ed.gov/ncee/wwc/InterventionReport/610.

q2 · i2 · causal · r2

The WWC findings table reports the sound unit test results for 181 grade 3–4 students: intervention mean 14.78 (SD 3.38), comparison mean 12.81 (SD 2.56), mean difference 1.97, effect size 0.65, improvement index +24, p-value 0.03, described as "Statistically significant".

"Sound unit test Grades 3–4 181 14.78 (3.38) 12.81 (2.56) 1.97 0.65 +24 0.03"

Discussion¶

Related Claims¶

• The supporting evidence for TEEMSS comes from a quasi-experimental study meeting WWC standards only with reservations — related
• The WWC rated TEEMSS as having potentially positive effects on general science achievement with a small extent of evidence — related
• Only one of eight unit outcomes in the qualifying study met WWC evidence standards; seven were excluded — related