Structured AI-supported writing instruction produced a large posttest writing proficiency advantage over traditional instruction in Saudi EFL undergraduates¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q2 · i3 large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i3 At posttest, the AI-supported experimental group outperformed the control group on academic writing proficiency, with a mean difference of 3.32 points and Hedges' g = 2.09. → Alshehri OAO 2026 q2 i? Groups were statistically equivalent at pretest on writing proficiency and DCTS, making pre-existing disparities an unlikely explanation for the posttest difference. → Alshehri OAO 2026 (2)

Evidence¶

Alshehri OAO 2026¶

Alshehri OAO, Lamouchi A, Abdellatif MS, Al-Dosari MNA, Mekheimer M and Nemt-allah MA (2026). From tool to scaffold: structured human–AI collaboration and its effects on academic writing and digital critical thinking among Saudi EFL learners. Front. Psychol. 17:1830103. https://doi.org/10.3389/fpsyg.2026.1830103

q2 · i3 · causal · r2

Between-group posttest comparison in a quasi-experimental pretest–posttest study of 53 Saudi EFL undergraduates in intact classes (experimental n = 31, control n = 22). The experimental group mean was 15.23 (SD 1.65) versus 11.91 (SD 1.44) for controls, "a large standardized effect (Hedges' g = 2.09, 95% CI [1.41, 2.76])".

"Between-group comparisons at posttest indicated a large and highly significant advantage for the experimental group, t(51) = 7.60, p < 0.001, with a mean difference of 3.32 points (95% CI [2.44, 4.20]) and a large standardized effect (Hedges' g = 2.09, 95% CI [1.41, 2.76])."

Alshehri OAO 2026 (2)¶

Alshehri OAO, Lamouchi A, Abdellatif MS, Al-Dosari MNA, Mekheimer M and Nemt-allah MA (2026). From tool to scaffold: structured human–AI collaboration and its effects on academic writing and digital critical thinking among Saudi EFL learners. Front. Psychol. 17:1830103. https://doi.org/10.3389/fpsyg.2026.1830103

q2 · i? · causal · r2

Baseline equivalence analysis using independent-samples t-tests on pretest scores in the same quasi-experiment. No statistically significant pretest group differences emerged for writing proficiency or DCTS total, indicating "observed post-intervention differences are unlikely to reflect substantial pre-existing group disparities".

"Baseline equivalence analyses showed no statistically significant pre-test differences between the experimental and control groups for writing proficiency, t(51) = 0.03, p = 0.977, or DCTS total, t(51) = 0.33, p = 0.741."

Discussion¶

Related Claims¶

• Structured AI-supported writing instruction produced a very large posttest advantage in digital critical thinking/AI literacy (DCTS) over traditional instruction — related
• Writing proficiency and digital critical thinking were strongly associated, and the association strengthened from pretest to posttest — related
• Fourth-graders receiving AI-enhanced media literacy instruction outperformed control-group peers on post-test critical media reading, writing, and total literacy with large effect sizes — related
• AI-supported PBL students obtain significantly higher posttest computational thinking scores than traditional-lecture students when controlling pretest scores — related
• In one quasi-experiment in EFL writing classes, students given AI-peer integrated feedback reported higher posttest cognitive engagement than students given conventional peer feedback — related
• AI-mediated language instruction produces significantly greater English learning achievement gains than traditional instruction among EFL learners — a broader claim this one bears on
• AI-peer integrated feedback produces significantly higher posttest affective engagement than conventional peer feedback in EFL writing — related
• In the 12-week quasi-experiment the experimental group's learning trajectory was significantly steeper than the control group's (group × time β = 0.52, 95% CI 0.31–0.73), with comparable baseline D-scores — related
• The Diagnostic Review class gained more writing points across three cycles than the Control class (Hedges' g = 1.12) — related