Structured AI-supported writing instruction produced a very large posttest advantage in digital critical thinking/AI literacy (DCTS) over traditional instruction¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q2 · i3 large
Currency · newest study 2026 · checked against its sources 2026-10-17 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims¶

q2 i3 At posttest, the experimental group scored far higher than controls on the Digital Critical Thinking Scale total, with a mean difference of 33.66 points and Hedges' g = 3.41. → Alshehri OAO 2026 q2 i? The experimental group showed large within-group DCTS gains while the control group showed no meaningful change. → Alshehri OAO 2026 (2)

Evidence¶

Alshehri OAO 2026¶

Alshehri OAO, Lamouchi A, Abdellatif MS, Al-Dosari MNA, Mekheimer M and Nemt-allah MA (2026). From tool to scaffold: structured human–AI collaboration and its effects on academic writing and digital critical thinking among Saudi EFL learners. Front. Psychol. 17:1830103. https://doi.org/10.3389/fpsyg.2026.1830103

q2 · i3 · causal · r2

Between-group posttest comparison on the DCTS (20 items, total 20–100) in the same quasi-experiment. Experimental posttest mean was 89.84 (SD 10.25) versus 56.18 (SD 8.94) for controls, "a very large standardized effect (Hedges' g = 3.41, 95% CI [2.55, 4.26])".

"Between-group comparisons confirmed a very large advantage for the experimental group at posttest, t(51) = 12.41, p < 0.001, with a mean difference of 33.66 DCTS points (95% CI [28.21, 39.11]) and a very large standardized effect (Hedges' g = 3.41, 95% CI [2.55, 4.26])."

Alshehri OAO 2026 (2)¶

Alshehri OAO, Lamouchi A, Abdellatif MS, Al-Dosari MNA, Mekheimer M and Nemt-allah MA (2026). From tool to scaffold: structured human–AI collaboration and its effects on academic writing and digital critical thinking among Saudi EFL learners. Front. Psychol. 17:1830103. https://doi.org/10.3389/fpsyg.2026.1830103

q2 · i? · causal · r2

Within-group paired-samples analyses reported descriptively in the same study. The experimental group's DCTS gain was statistically significant while the control group's was not, with control gain M = 0.05 (SD 0.21) on the 20–100 scale.

"For DCTS total, the experimental group showed large gains from pre-test to posttest, t(30) = 27.59, p < 0.001, whereas the control group showed no meaningful change, t(21) = 1.00, p = 0.329."

Discussion¶

Learner Variables¶

• Digital Literacy — outcome: instruction changes it
• Academic and Critical Literacy — outcome: instruction changes it

Related Claims¶

• AI literacy interventions show a large, statistically significant overall positive effect on student AI literacy outcomes (g = 0.837) — the general claim this finding bears on, with the studies behind it
• Structured AI-supported writing instruction produced a large posttest writing proficiency advantage over traditional instruction in Saudi EFL undergraduates — related
• Writing proficiency and digital critical thinking were strongly associated, and the association strengthened from pretest to posttest — related
• In-service secondary science educators score a mean of 16.7 of 30 points on a validated general AI literacy test — related
• Fourth-graders receiving AI-enhanced media literacy instruction outperformed control-group peers on post-test critical media reading, writing, and total literacy with large effect sizes — related