In a within-subjects user study with more than 100 students, explanations generated by the Intelligent Explanation Generator were rated significantly higher than those of random-question and generic-question baselines¶
Claim · All claims
Evidence · 1 study · causalr?·q3
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Students rated YAI4Edu's Intelligent Explanation Generator explanations statistically better on average than two baseline alternatives, with P values below .005. → Sovrano Francesco 2024
Evidence¶
Sovrano Francesco 2024¶
Sovrano Francesco, Ashley Kevin, Brusilovsky Peter Leonid, Vitali Fabio. (2024). How to Improve the Explanatory Power of an Intelligent Textbook: a Case Study in Legal Writing. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-024-00399-w
q3 · i? · causal · r?
Within-subjects user study with more than 100 English-speaking students who rated explanations on a 0-to-5-star scale for how well they explained a topic. The article reports the ratings were "statistically better than two baseline alternatives (P values below .005)"; no effect size is printed.
"The students rated YAI4Edu’s explanations the highest. According to the students, the explanatory content generated by YAI4Edu is, on average, statistically better than two baseline alternatives (P values below .005)."
Discussion¶
Related Claims¶
- Explanations generated from generic questions were rated significantly better than those generated from random questions, supporting the hypothesis that question selection strategy matters — related
- Prompting learners to self-explain, one generative strategy, improves learning by a moderate average amount; other generative activities are not tested by the evidence recorded here — related
- Prompting learners to self-explain improves understanding and problem solving on immediate tests by a moderate average amount, with little evidence yet on delayed or classroom gains. — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
yai4edu-intelligent-explanations-rated-higher-than-baselines |
title |
In a within-subjects user study with more than 100 students, explanations generated by the Intelligent Explanation Generator were rated significantly higher than those of random-question and generic-question baselines |
description |
In a within-subjects user study with more than 100 students, explanations generated by the Intelligent Explanation Generator were rated significantly higher than those of random-question and generic-question baselines |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2024 |
generated |
by process:wiki-ingest on 2026-10-27 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — sovrano-francesco-2024 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.