In a hypothetical trial, responder rates differed greatly between treatment and control groups, with the treatment group showing higher rates in positive-gain categories¶

Claim · All claims
Evidence · 1 study · theoretical r2 · q1
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q1 i? In the illustrative hypothetical trial, the treatment group showed a clear tendency toward higher responder rates in the 0 to 50% and > 50% gain categories, whereas the pattern was reversed in the < 0% (no gain) category. → Zitzmann 2023

Evidence¶

Zitzmann 2023¶

Zitzmann, S., Machts, N., Hübner, N., Schauber, S., Möller, J., & Lindner, C. (2023). The Yet Underestimated Importance of Communicating Findings from Educational Trials to Teachers, Schools, School Authorities, or Policy Makers (Comment on Brady et al. (2023)). Educational Psychology Review. https://doi.org/10.1007/s10648-023-09776-8

q1 · i? · theoretical · r2

Illustrative numerical example (Fig. 1) of a hypothetical trial, not real data: responder rates for treatment and control groups using illustrative cutoffs of 0% and 50%, which the authors call "certainly not very valid examples of cutoffs." The pattern indicates a much larger amount of students gained substantially in the treatment group.

"the responder rates differed greatly between these groups, with a clear tendency for the treatment group to show higher responder rates in categories of positive gain (i.e., in the 0 to 50% and > 50% categories), whereas this pattern was reversed in the category of no gain (i.e., in the < 0% category)."

Discussion¶

Related Claims¶

• T-tests within each experiment found no significant advantage for the contrast-based experimental group over the control groups in long-term gain — related