Feedback is more effective for cognitive and physical outcomes than for motivational and behavioral outcomes¶

Claim · All claims
Evidence · 2 studies · 2 quant-synthesis r3 · q3
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Outcome measure is a significant moderator: cognitive outcomes average d = 0.51 and physical d = 0.63, versus motivational d = 0.33 and behavioral d = 0.48 (CI crossing zero). → Wisniewski B 2020 q3 i? 21% of effect sizes for motivational outcomes were negative, with 86% of those negative-effect interventions being uninformative feedback (rewards or punishments). → Wisniewski B 2020 (2)

Evidence¶

Wisniewski B 2020¶

Wisniewski B, Zierer K and Hattie J (2020) The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research. Front. Psychol. 10:3087. https://doi.org/10.3389/fpsyg.2019.03087

q3 · i? · quant-synthesis · r3

Mixed-effects moderator analysis by outcome measure (Table 3). Cognitive outcomes (k = 597) average d = 0.51; motivational (k = 109) d = 0.33; physical (k = 19) d = 0.63; behavioral (k = 30) d = 0.48 with CI [−0.09–1.06].

"Cognitive 597 0.51 [0.46 – 0.55] 3689.88 83.8% Motivational 109 0.33 [0.23 – 0.42] 600.96 82.0% Physical 19 0.63 [0.34– 0.92] 36.65 50.9% Behavioral 30 0.48 [ −0.09 – 1.06] 0.28 50.0%"

Wisniewski B 2020 (2)¶

Wisniewski B, Zierer K and Hattie J (2020) The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research. Front. Psychol. 10:3087. https://doi.org/10.3389/fpsyg.2019.03087

q3 · i? · quant-synthesis · r3

Descriptive analysis of the motivational-outcome subset of the meta-analysis. The authors report that "Twenty one percent of the effect sizes related to motivational outcomes in our data were negative", mostly from uninformative rewards or punishments.

"Twenty one percent of the effect sizes related to motivational outcomes in our data were negative, with 86% of the feedback interventions leading to these negative effects being uninformative (rewards or punishments)."

Studies bearing on this claim¶

Does feedback improve physical and motor skill outcomes, and does letting learners decide when they receive it help? This table gathers the studies behind this claim and the 4 narrower claims that bear on it: 2 distinct studies (1 quant-synthesis, 1 causal), q3, 1 of 2 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

Related Claims¶

• Feedback effect estimates are higher in pre-post designs (d = 0.63) than controlled designs (d = 0.42) and in journal articles (d = 0.49) than dissertations (d = 0.36) — related
• Feedback improves learning by a medium amount on average, but its effect varies widely with the information it carries, and a substantial share of feedback effects are negative — a broader claim this one bears on
• Gamification has small positive effects on cognitive, motivational and behavioral learning outcomes — related
• Explanatory feedback positively moderates only the path from decision-making agent to perceived fairness, not the direct path to decision acceptance — related
• Game benefits are similar in magnitude for cognitive and intrapersonal outcomes, while the single interpersonal outcome was not significant — related