Expert EAP reviewers rated GenAI-generated differentiated materials favorably for academic fidelity, proficiency appropriateness, and teachability¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Three independent EAP instructors rated 15 anonymized material versions above 4.00 on academic fidelity, proficiency appropriateness, and teachability, with acceptable inter-rater reliability. → Gao X 2026

Evidence¶

Gao X 2026¶

Gao X (2026) From unified to differentiated materials: generative AI–supported adaptation of EAP reading materials. Front. Psychol. 17:1887565. https://doi.org/10.3389/fpsyg.2026.1887565

q3 · i? · causal · r2

Expert review of 15 anonymized material versions by three independent EAP reviewers with at least 5 years of tertiary EAP experience, blind to condition. Ratings included "academic fidelity (M = 4.24, SD = 0.41)" and teachability M = 4.31; inter-rater reliability was ICC(2,k) = 0.84, 95% CI [0.76, 0.91].

"They rated the materials favorably for academic fidelity (M = 4.24, SD = 0.41), proficiency appropriateness (M = 4.36, SD = 0.38), and teachability (M = 4.31, SD = 0.44); the overall quality mean was M = 4.30 (SD = 0.37)."

Discussion¶

Related Claims¶

• Differentiated-AI EAP versions showed limited passage-level structural separation, with automated complexity metrics failing to classify intended proficiency labels — related
• Differentiated-AI materials exceeded unified-AI materials on reading comprehension within each proficiency stratum, most strongly for high-proficiency learners (d = 1.40) — related
• One pilot instructor reported the adaptive proctor differentiated students at multiple proficiency boundaries and decoupled conceptual mastery from computational speed — related
• The Proficiency × Material interaction on reading comprehension was significant, indicating heterogeneous material effects across proficiency strata — related
• Immediate unsupported application on a new passage showed no material-condition effect and no Proficiency × Material interaction, indicating no short-term dependence cost — related
• EAP task performance showed the same directional pattern as reading comprehension but with a weaker Proficiency × Material interaction — related