GenAI chatbot yielded immediate essay score gains but no gains in intrinsic motivation or longer-term knowledge outcomes¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? One-way ANOVAs found no significant between-group differences on any of the four Intrinsic Motivation Inventory subscales. → Li 2025 q3 i? GenAI chatbot gains in essay scores were not accompanied by increases in intrinsic motivation and did not generalise to longer-term knowledge outcomes. → Li 2025

Evidence¶

Li 2025¶

Li, X., Li, T., Yan, L., Li, Y., Zhao, L., Raković, M., Molenaar, I., Gašević, D., & Fan, Y. (2025). FLoRA: An Advanced AI-Powered Engine to Facilitate Hybrid Human-AI Regulated Learning. https://arxiv.org/abs/2507.07362

q3 · i? · causal · r?

Post-task Intrinsic Motivation Inventory comparison across the four experimental groups in the ESL writing study found no significant differences on Interest/Enjoyment, Perceived Competence, Effort/Importance, or Pressure/Tension.

"No significant between-group differences were observed for Interest/Enjoyment (𝐹= 1.087,𝑝= 0.358,𝜂2 = 0.029), Perceived Competence (𝐹= 0.453,𝑝= 0.716,𝜂 2 = 0.012), Effort/Importance (𝐹= 1.152,𝑝= 0.332,𝜂 2 = 0.030), or Pressure/Tension (𝐹= 0.546,𝑝= 0.652,𝜂 2 = 0.015)."

Discussion¶

Related Claims¶

• As cited second-hand in an AI-literacy framework paper: ChatGPT use improved short-term essay scores but triggered metacognitive laziness with no significant knowledge-transfer gains — possibly the same claim (merge candidate)
• Learners supported by ChatGPT, a human expert, checklist tools, or no support show no significant difference in post-task intrinsic motivation — possibly the same claim (merge candidate)
• No significant group differences in knowledge gain or knowledge transfer despite ChatGPT's task-performance advantage — a narrower finding that bears on this claim
• The ChatGPT group achieves significantly greater essay score improvement than the other three groups — a narrower finding that bears on this claim
• Frequent generative AI use for essay writing can foster metacognitive laziness, reducing intrinsic motivation and learning autonomy — related
• Purpose-built AI chatbot coaching is generally well received and supports short-term motivation and selected behavior change, but effects on sustained, meaningful outcomes are inconsistent — related
• Control-group students showed no significant change in intrinsic motivation over the same semester — related