Adding a teachable agent to the standard science curriculum improved fourth-graders' learning gains on both curriculum tests and researcher-designed hierarchical reasoning tests¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i3 large
Currency · newest study 2013 · checked against its sources 2026-10-17 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

q3 i3 Kit+TA students improved more than Kit-Only students on basic-value (curriculum) measures; the article prints an effect size of d = 1.1 for this learning-gain difference. → Doris B. Chin 2013 q3 i3 Kit+TA students improved more than Kit-Only students on added-value hierarchical-reasoning measures; the article prints an effect size of d = 0.93 for this learning-gain difference. → Doris B. Chin 2013

Evidence¶

Doris B. Chin 2013¶

Doris B. Chin, Ilsa M. Dohmen, and Daniel L. Schwartz. (2013). Young Children Can Learn Scientific Reasoning with Teachable Agents. IEEE Transactions on Learning Technologies. https://doi.org/10.1109/TLT.2013.24

q3 · i3 · causal · r2

A 2-year quasi-experiment with seven fourth-grade classrooms (Kit+TA versus Kit-Only, same instructional time) analyzed with doubly repeated measures. The article prints the learning-gain effect sizes favoring Kit+TA: d ¼ 1:1 on basic-value and d ¼ 0:93 on added-value measures (i.e., d = 1.1 and d = 0.93 as reported).

"The Kit+TA students improved more on both measures; basic-value F ð1; 131Þ¼ 32:8;p < 0:001; added-value F ð1; 131Þ¼ 19:0;p < 0:001. The effect sizes for the learning gains of the Kit+TA condition over the Kit-Only condition were d ¼ 1:1, and d ¼ 0:93 for the basic- and added-value measures, respectively."

Discussion¶

Related Claims¶

• Kit+TA students spontaneously transferred the TA's hierarchical spatial organization to open-ended post-test answers, unlike Kit-Only students — a narrower finding that bears on this claim
• The treatment-by-time interaction was significant, and results replicated across both yearly cohorts for both measures — a narrower finding that bears on this claim
• Before instruction, control students started significantly higher on basic-value measures, yet were overtaken after instruction — a narrower finding that bears on this claim
• Students who teach a ChatGPT teachable agent in natural language achieve greater knowledge gains than students who learn the same material from online videos — a broader claim this one bears on
• Teaching a ChatGPT agent improves students' self-regulated learning, specifically self-efficacy and use of cognitive strategies — related
• Information at higher levels of an acquired hierarchical organization is recalled better than information at lower levels — related
• A hierarchical internal knowledge organization facilitates performance on complex recall and problem-solving tasks more than a single-level organization of the same knowledge — related
• Fourth-graders receiving AI-enhanced media literacy instruction outperformed control-group peers on post-test critical media reading, writing, and total literacy with large effect sizes — related