ITS significantly outperform large-group human instruction, individual computer-based instruction, and textbooks or workbooks, but not small-group or individual human tutoring¶

Claim · All claims
Evidence · 1 study (2 entries) · quant-synthesis r3 · q4 · i2 medium
Currency · newest study 2014 · checked against its sources 2026-10-20 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims¶

q4 i2 Under a random-effects model, ITS comparisons produced moderate, statistically significant mean effect sizes over large-group human instruction (g = .44), individual CBI (g = .57), and individual textbook or workbook use (g = .36). → Wenting Ma 2014 q4 i? Small-group human instruction (g = .05) and individual human instruction (g = -.11) did not differ significantly from ITS. → Wenting Ma 2014 (2)

Evidence¶

Wenting Ma 2014¶

Wenting Ma, Olusola O. Adesope, John C. Nesbit, and Qing Liu. (2014). Intelligent Tutoring Systems and Learning Outcomes: A Meta-Analysis. Journal of Educational Psychology. https://doi.org/10.1037/a0037123

q4 · i2 · quant-synthesis · r3

Comparison-treatment moderator analysis of the meta-analysis (Table 1), with large-group human instruction (N = 11,296, k = 66, g = .44), individual CBI (N = 1,034, k = 15, g = .57), and individual textbook or workbook (N = 1,403, k = 17, g = .36), all statistically significant; between-levels variance significant under both models (p < .001).

"Post hoc analyses found studies which com pared the use of ITS to larg e-group hum an instruction had effect sizes sim ilar to those which com pared ITS to individual com puter-based instruction and indi vidual use of textbooks or workbooks"

Wenting Ma 2014 (2)¶

Wenting Ma, Olusola O. Adesope, John C. Nesbit, and Qing Liu. (2014). Intelligent Tutoring Systems and Learning Outcomes: A Meta-Analysis. Journal of Educational Psychology. https://doi.org/10.1037/a0037123

q4 · i? · quant-synthesis · r?

Comparison-treatment moderator analysis (Table 1). Small-group human instruction (k = 4, g = .05) and individual human instruction (k = 5, g = -.11) showed no statistically significant difference from ITS; equivalence was not tested.

"Indivi dual hum an instruction (i.e., hum an tutoring) appeared to offe r a small, non-significant advantage over the use of ITS."

Discussion¶

Related Claims¶

• A narrative review of intelligent tutoring systems asserts, citing one source, that students in personalized learning environments outperform peers in standardized settings — the general claim this finding bears on, with the studies behind it
• Intelligent tutoring systems improve achievement over non-individualised instruction — possibly the same claim (merge candidate)
• Learning with intelligent tutoring systems yields a moderate, statistically significant overall advantage in achievement over non-ITS modes of instruction — a broader claim this one bears on
• Intelligent tutoring systems show moderate learning benefits but are less effective than human tutoring — possibly the same claim (merge candidate)
• Meta-analytic evidence indicates intelligent tutoring systems yield positive learning outcomes compared with non-ITS conditions — possibly the same claim (merge candidate)
• The measured advantage of computer-based instruction over conventional teaching shrinks when the same teacher teaches both versions — related
• AutoTutor's learning gains are virtually equivalent to those of 1-to-1 human tutoring in direct comparisons — a narrower finding that bears on this claim
• Intelligent tutoring systems with dynamic student modeling increase learning gains over regular instruction — possibly the same claim (merge candidate)
• ITS augmentation: meta-analyses find medium to large learning benefits of ITS over unsupported learning and small to medium gains over less adaptive computer-assisted learning — related