Complement AI tutoring with group recitations or instructor guidance rather than treating it as a replacement for human instruction¶

Strategy · All strategies
Evidence · 1 claim (1 for) · 1 study (1 design), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

The authors recommend that AI Socratic tutoring be embedded alongside human instructional structures. They state "the chatbot is not meant to replace human instructors or peer collaboration" and that "AI tutoring should be complemented by group recitations or instructor guidance," motivated by the uneven motivation gains observed in their survey data. Future plans include adaptive feedback loops that identify common misconceptions and refine the Verifier's scaffolding as dialogue data accumulate.

Design Implications¶

Context¶

Requirements¶

• Dialogue data accumulation to support adaptive feedback loops that identify common misconceptions

Constraints¶

• The article states motivation gains were uneven, motivating the recommendation to pair AI tutoring with human structures

Target Learners¶

• undergraduate STEM students in large-enrollment courses

Target Learning Goals¶

• problem-solving skills and confidence in physics

Claims¶

• Student surveys show widespread weekly AI use, requests for instructor guidance, and a substantial minority using AI to produce entire solutions [+W]

Related Strategies¶

• Set clear AI guardrails positioning AI as a complement to human instruction with age-appropriate progressions
• Treat AI as a guided support tool and explicitly build verification and skepticism into learning goals

Examples¶

-

Key Sources¶

• Syed Furqan Abbas Hashmi, N. Sanjay Rebello. (2025). Analyzing Undergraduate Problem-Solving in Physics Through Interaction With an AI Chatbot. https://arxiv.org/abs/2508.14778