The variability of feedback-intervention effects, including negative effects, exceeds sampling error and is robust to exclusion of a single prolific lab¶

Claim · All claims
Evidence · 1 study · quant-synthesis r2 · q3
Currency · newest study 1996 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The weighted variance of feedback-intervention effect sizes (0.97) far exceeds the estimated sampling-error variance (0.09), and 33% of effects remain negative after excluding Mikulincer's studies. → Kluger 1996

Evidence¶

Kluger 1996¶

Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254-284. https://doi.org/10.1037/0033-2909.119.2.254

q3 · i? · quant-synthesis · r2

Sensitivity analysis within the same meta-analysis: 91 effects came from Mikulincer's laboratory experiments, whose weighted average d was -0.39 versus 0.47 for the remaining data. After exclusion, "the weighted variance of d was .92" and 33% of remaining effects were still negative. No effect size is printed for the variability itself.

"Yet, after the exclusion of Mikulincer's studies, the weighted variance of d was .92, such that 33% of the remaining effects were still negative."

Discussion¶

Related Claims¶

• Feedback improves learning by a medium amount on average, but its effect varies widely with the information it carries, and a substantial share of feedback effects are negative — the general claim this finding bears on, with the studies behind it
• Study effect sizes are heterogeneous (I² reported as 83.197%), so a random-effects model is used for the summary effect — related
• The pooled association is robust to dependence, baseline-adjustment, risk-of-bias, and effect-size-derivation sensitivity analyses — related