Human-made teaching videos produce a statistically significant but small advantage over AI-generated videos in participants' learning experience ratings¶

Claim · All claims
Evidence · 1 study · causal r? · q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Participants rated their learning experiences more favorably after human-made videos than after AI-generated videos, with a statistically significant but small advantage. → Netland 2025

Evidence¶

Netland 2025¶

Netland, Torbjörn; von Dzengelevski, Oliver; Tesch, Katalin. (2025). Comparing human-made and AI-generated teaching videos: An experimental study on learning effects. Computers & Education. https://doi.org/10.1016/j.compedu.2024.105164

q3 · i? · causal · r?

Across-subject online experiment with 447 participants comparing AI-generated and human-made teaching videos; the article reports a "statistically significant but small advantage" in learning experience ratings for human-made videos.

"The findings show that human-generated videos provided a statistically significant but small advantage to participants in terms of learning experience, indicating that the participants still prefer to be taught by human teachers."

Discussion¶

Related Claims¶

• Participants acquired knowledge to a similar degree from AI-generated and human-made teaching videos as measured by multiple-choice exam results — related
• Students oppose preferring AI videos over instructor-recorded videos and distrust AI video information as much as human-presented information — related
• Computing students rate short AI-generated Markdown videos favorably across quality, comprehension, and accuracy dimensions — related
• Test-takers rate LLM-generated feedback as persuasive and useful as human instructor feedback (Wilcoxon signed-rank tests show no significant difference) — related
• Students rated human TA responses more favorably overall but preferred ChatGPT responses 40% of the time — related