Across-subject online experiment comparing AI-generated and human-made teaching videos¶
Design · All designs
Evidence · 2 claims (2 for) · 1 study (1 causal),q3· 0 of 1 report an effect size · 2 claims rest on one study
Description¶
An online experiment with an "across-subject experimental design" in which 447 participants completed two treatment conditions presenting different mixes of AI-generated and human-made videos, with 1788 video treatments in total. Participants rated learning experiences after each video and took a multiple-choice exam at the end of the session.
Design Implications¶
Context¶
Requirements¶
- two treatment conditions presenting different mixes of AI-generated and human-made videos
Constraints¶
Target Learners¶
- 447 participants in an online experiment
Learning Goals¶
- learning experience
- content knowledge in a management course
Claims¶
- Participants acquired knowledge to a similar degree from AI-generated and human-made teaching videos as measured by multiple-choice exam results [+W]
- Human-made teaching videos produce a statistically significant but small advantage over AI-generated videos in participants' learning experience ratings [+W]
Related Designs¶
Examples¶
-
Key Sources¶
- Netland, Torbjörn; von Dzengelevski, Oliver; Tesch, Katalin. (2025). Comparing human-made and AI-generated teaching videos: An experimental study on learning effects. Computers & Education. https://doi.org/10.1016/j.compedu.2024.105164
Page metadata
| Field | Value |
|---|---|
type |
design |
id |
across-subject-experiment-ai-vs-human-videos |
title |
Across-subject online experiment comparing AI-generated and human-made teaching videos |
description |
An online experiment with an "across-subject experimental design" in which 447 participants completed two treatment conditions presenting different mixes of AI-generated and human-made videos, with 1788 video treatmen... |
status |
review |
generated |
by process:settle-candidates on 2026-10-30 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — netland-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.