Students scored an average of 4.3 out of 5 on a Markdown quiz after watching the AI-generated videos, suggesting short-term learning¶
Claim · All claims
Evidence · 1 study · associationalr1·q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Average aggregate test scores across five Markdown quiz questions were 4.3 at both institutions, which the authors interpret as students learning fairly well from the AI-generated videos. → Esse Ciego 2026
Evidence¶
Esse Ciego 2026¶
Esse Ciego, Shubbhi Taneja, Wilson Wong, and Amanpreet Kapoor. (2026). Student Perceptions and Preferences Regarding AI-Generated Instructional Videos in Computing Education. https://arxiv.org/abs/2607.28203 doi:10.48550/arxiv.2607.28203
q2 · i? · associational · r1
Post-survey knowledge test with five multiple-choice questions on video content, from the descriptive study of 170 students. The authors state this "suggests that students learned fairly well about Markdown from the AI-generated videos."
"The average aggregate test score across the five Markdown quiz questions (possible range: 0-5) at institution 1 was 𝜇𝑖1 = 4.3(min: 1; max: 5; median: 5; 𝜎= 0.88) and at institution 2 was 𝜇𝑖2 = 4.3(min: 3; max: 5; median: 4; 𝜎= 0.62)."
Discussion¶
Related Claims¶
- Computing students rate short AI-generated Markdown videos favorably across quality, comprehension, and accuracy dimensions — related
- Test-taking disengagement distorts both individual and aggregated test scores — a broader claim this one bears on
- Rapid-guessing behavior can distort test scores and adversely affect measurement — a broader claim this one bears on
- Students oppose preferring AI videos over instructor-recorded videos and distrust AI video information as much as human-presented information — related
- Student ratings of the AI-generated materials ranged from an average of 8.5 to 9.9 out of 10 across validated modules, based on over 600 voluntary anonymous evaluations. — related
- Viewing of the personalized AI videos declined sharply across the quarter, with views of the first week-9 video set suggesting fewer than 10% of the course population was watching voluntarily by the end of the course — related
- After hands-on use, 96% of students wanted AIDA in their studies, with the quiz function the most liked feature — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-video-viewing-yields-quiz-scores-4-3 |
title |
Students scored an average of 4.3 out of 5 on a Markdown quiz after watching the AI-generated videos, suggesting short-term learning |
description |
Students scored an average of 4.3 out of 5 on a Markdown quiz after watching the AI-generated videos, suggesting short-term learning |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
source_checked |
2026-10-20 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — esse-ciego-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.