Metacognitive chatbot feedback raises metacognitive sensitivity relative to affective and neutral feedback¶
Claim · All claims
Evidence · 1 study · causalr2·q3·i2medium
Currency · newest study 2025 · checked against its sources 2026-10-26 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i2 After controlling pre-test metacognitive sensitivity, metacognitive sensitivity differed significantly by feedback type (F = 5.48, p = 0.006, effect size 0.12), with the metacognitive group (M = 0.71) higher than affective (M = 0.63) and neutral (M = 0.63) groups. → Yin 2025
Evidence¶
Yin 2025¶
Yin, J., Xu, H., Pan, Y., & Hu, Y. (2025). Effects of different AI-driven Chatbot feedback on learning outcomes and brain activity. npj Science of Learning. https://doi.org/10.1038/s41539-025-00311-8
q3 · i2 · causal · r2
Post-answer confidence ratings on the post-test measured metacognitive sensitivity via type 2 ROC analysis in the randomized chatbot experiment. The omnibus ANCOVA was significant (F = 5.48, p = 0.006, effect size 0.12, power 0.84); "metacognitive sensitivity was comparable between the AF and NF groups ( corrected p > 0.999)".
"metacognitive sensitivity in the MF group (M = 0.71, SD = 0.11) was signi ficantly higher than in the NF group (M = 0.63, SD = 0.12; corrected p = 0.018) and the AF group ( M = 0.63, SD = 0.10; corrected p = 0.014)."
Discussion¶
Learner Variables¶
- Metacognition — outcome: instruction changes it
- Self-Regulation — outcome: instruction changes it
Related Claims¶
- Metacognitive and affective chatbot feedback each produce higher retention scores than neutral feedback, with no significant difference between metacognitive and affective groups — related
- Metacognitive chatbot feedback produces higher transfer scores than both affective and neutral feedback — related
- Feedback types elicit distinct fNIRS activation patterns: frontopolar and middle temporal gyrus higher under metacognitive feedback, supramarginal gyrus under affective feedback, DLPFC under neutral feedback — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
chatbot-metacognitive-feedback-raises-metacognitive-sensitivity |
title |
Metacognitive chatbot feedback raises metacognitive sensitivity relative to affective and neutral feedback |
description |
Metacognitive chatbot feedback raises metacognitive sensitivity relative to affective and neutral feedback |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
source_checked |
2026-10-26 |
generated |
by process:wiki-ingest on 2026-10-26 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — yin-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.