Metacognitive chatbot feedback produces higher transfer scores than both affective and neutral feedback¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i2 medium
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i2 After controlling pre-test knowledge, transfer scores differed significantly by feedback type (F = 6.75, p = 0.002, effect size 0.14), with metacognitive feedback higher than both affective and neutral feedback. → Yin 2025

Evidence¶

Yin 2025¶

Yin, J., Xu, H., Pan, Y., & Hu, Y. (2025). Effects of different AI-driven Chatbot feedback on learning outcomes and brain activity. npj Science of Learning. https://doi.org/10.1038/s41539-025-00311-8

q3 · i2 · causal · r2

ANCOVA of transfer scores (new-application questions, maximum 15 points) in the randomized three-group chatbot experiment. MF (M = 9.38, SD = 2.88) exceeded NF (M = 6.72, SD = 3.34; corrected p = 0.002) and AF (M = 7.59; corrected p = 0.050); "transfer scores were comparable between the AF and NF groups".

"students’transfer scores showed a significant difference in the feedback type ( F = 6.75, p = 0.002). The effect size was 0.14, and the statistical power was 0.91. Bonferroni post-hoc comparisons revealed that transfer scores in the MF group ( M = 9.38, SD = 2.88) were sig- nificantly higher than in the NF group"

Discussion¶

Related Claims¶

• Metacognitive and affective chatbot feedback each produce higher retention scores than neutral feedback, with no significant difference between metacognitive and affective groups — related
• Metacognitive chatbot feedback raises metacognitive sensitivity relative to affective and neutral feedback — related
• Feedback types elicit distinct fNIRS activation patterns: frontopolar and middle temporal gyrus higher under metacognitive feedback, supramarginal gyrus under affective feedback, DLPFC under neutral feedback — related