Effects of ITSs are mitigated when compared to non-intelligent tutoring systems: three of four comparisons found no significant difference in learning gains¶

Claim · All claims
Evidence · 1 study · review r3 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? When ITSs were compared to non-intelligent digital tutoring systems, only one study reported positive learning gains while three found no significant difference in learning gains. → Létourneau 2025

Evidence¶

Létourneau 2025¶

Létourneau, A., Martineau, M. D., Charland, P., Karran, J. A., Boasen, J. & Léger, P. M. (2025). A systematic review of AI-driven intelligent tutoring systems (ITS) in K-12 education. npj Science of Learning 10:29. https://doi.org/10.1038/s41539-025-00320-7

q2 · i? · review · r3

The review's synthesis of the ITS-vs-non-intelligent-TS category, all conducted in high school physics classes, found results were contradictory: only Ingkavara et al. showed significantly higher learning gains for the ITS group. Equivalence was not tested.

"One study reported positive learning gains with the ITS 37, while the other three reported no significant difference in learning gains between the ITS and the non-intelligent tutoring system 32,36,41,48."

Discussion¶

Related Claims¶

• Pedagogical augmentations of ITSs show inconsistent effects: self-assessment helped in some studies but not others, while personalization and matched test-practice format showed benefits — related
• Most ITS-versus-teacher studies in K-12 report a positive effect of ITSs on student performance, with medium-to-large effect sizes — related
• The introduction reports that the VCR tutor produced statistically significant performance gains in using the VCR, a rare result for ITSs at the time — related