Reflective and hybrid feedback outperform direct GenAI feedback on delayed AI-free transfer¶

Claim · All claims
Evidence · 1 study · causal r3 · q4 · i1 small
Currency · newest study 2026 · checked against its sources 2026-10-17 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q4 i1 Both reflective (Cohen's d = 0.39) and hybrid (d = 0.48) feedback outperformed direct GenAI-supported feedback on delayed AI-free transfer, while the direct–peer contrast was negative and non-significant (d = −0.12, p = .149). → Ates 2026

Evidence¶

Ates 2026¶

Ates, H. (2026). Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation. International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-026-00614-9

q4 · i1 · causal · r3

Delayed AI-free transfer was a novel supervised argumentation task without GenAI access; mixed-effects model, F(3, 43.9) = 12.03, p < .001. Table 4 Panel B prints Cohen's d = 0.39 for reflective versus direct GenAI, d = 0.48 for Hybrid vs Direct GenAI, and d = −0.12 for Direct GenAI vs Peer.

"Reflective GenAI – Direct GenAI 1.15 0.26 < .001 0.39 [0.64, 1.66]"

Discussion¶

Related Claims¶

• Evidence suggests over-reliance on generative AI may negatively affect students' self-regulated learning behaviors, potentially harming retention and transfer to novel contexts — the general claim this finding bears on, with the studies behind it

• Reflection improves correspondence between perceived and behavioral reliance on ChatGPT — the general claim this finding bears on, with the studies behind it

• How genAI is used, not who uses it, predicts whether independent performance declines or improves — the general claim this finding bears on, with the studies behind it

• Feedback improves learning by a medium amount on average, but its effect varies widely with the information it carries, and a substantial share of feedback effects are negative — the general claim this finding bears on, with the studies behind it

• Direct GenAI-supported feedback improves immediate argument-quality gain over peer feedback, while reflective and hybrid designs outperform direct GenAI feedback — related
• Hybrid feedback outperforms direct GenAI feedback on conceptual learning; the reflective–direct contrast is positive but non-significant — related