Industry-targeted videos scored only slightly higher on personalization depth than generic-audience videos (0.32 points; modeled increment 0.25, p = 0.11), an effect not resolved under reviewer clustering¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Industry-targeted videos scored 0.32 points higher on personalization depth B1 than generic-audience videos (3.97 vs. 3.65); a mixed model with a reviewer random intercept estimated the increment at 0.25 (95% CI[−0.06, 0.56], p = 0.11). → Romain Puech 2026
Evidence¶
Romain Puech 2026¶
Romain Puech, Dewang Kumar Agarwal, Antonio Santamaría Escobar, Dimitris Bertsimas. (2026). Bespoke: Generating MOOC-Quality Industry-Personalized Lecture Videos at Scale. arXiv preprint. https://arxiv.org/abs/2609.26540 doi:10.48550/arxiv.2609.26540
q2 · i? · design · r2
Comparison of industry-targeted versus generic-audience videos within the 92-video expert rating study, analyzed with a mixed model including a reviewer random intercept. The article reports the raw B1 difference of 0.32 points and the modeled increment of 0.25 with p = 0.11.
"Industry-targeted videos score 0.32 points higher on B1 (3.97 vs. 3.65). A mixed model with a reviewer random intercept estimates that increment at 0.25 (95% CI[−0.06,0.56],𝑝=0.11)."
Discussion¶
Related Claims¶
- Domain-matched experts judged 87% of Bespoke-generated lecture videos at or above the rubric midpoint corresponding to a standard MOOC lecture's quality (mean G = 3.42 of 5) — related
- Across rubric dimensions, content scored highest (A = 4.03) while production scored lowest (D = 3.41), driven by synthetic voice quality (D1 = 3.16) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
bespoke-industry-personalization-increment-small-nonsignificant |
title |
Industry-targeted videos scored only slightly higher on personalization depth than generic-audience videos (0.32 points; modeled increment 0.25, p = 0.11), an effect not resolved under reviewer clustering |
description |
Industry-targeted videos scored only slightly higher on personalization depth than generic-audience videos (0.32 points; modeled increment 0.25, p = 0.11), an effect not resolved under reviewer clustering |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — romain-puech-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.