Students using the AI-GFCA learning model outperform AI-supported conventional-learning peers in role-play performance at both measured tasks¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r1–r2 · q2 · i3 large
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person
Design limits · Darmawansah 2025: groups were assigned but students were analysed as independent · Darmawansah 2025 (2): groups were assigned but students were analysed as independent (read from the study by two models, 2026-10-29)

Subclaims¶

q2 i3 The AI-GFCA group scored higher than the AI-C group on the first role-play task (T1). → Darmawansah 2025 q2 i3 The AI-GFCA group scored higher than the AI-C group on the second role-play task (T2). → Darmawansah 2025 (2)

Evidence¶

Darmawansah 2025¶

Darmawansah, D., Hwang, G.-J., Lin, C.-J., & Febiyani, F. (2025). An artificial intelligence-supported GFCA learning model to enhance L2 students' role-play performance, English speaking and interaction mindset. Education Tech Research Dev (2025) 73:1451–1479. https://doi.org/10.1007/s11423-025-10453-6

q2 · i3 · causal · r2

Mann–Whitney U test of expert-rated role-play performance (five-dimension rubric, Kendall's ω 0.83–0.91) in a quasi-experiment with 23 AI-GFCA vs 22 AI-C students; the AI-GFCA group "performed better in the first role-play task (T1)" with r = 0.546.

"the AI-GFCA group (Mdn = 3.6) performed better in the first role-play task (T1) than the AI-C group (Mdn = 3.4) with U = 139.50, z = − 2.622, p = 0.009, and r = 0.546."

Darmawansah 2025 (2)¶

Darmawansah, D., Hwang, G.-J., Lin, C.-J., & Febiyani, F. (2025). An artificial intelligence-supported GFCA learning model to enhance L2 students' role-play performance, English speaking and interaction mindset. Education Tech Research Dev (2025) 73:1451–1479. https://doi.org/10.1007/s11423-025-10453-6

q2 · i3 · causal · r1

Second Mann–Whitney comparison of expert-rated role-play performance in the same quasi-experiment; the AI-GFCA group "outperformed the AI-C group in the second role-play task (T2)" with r = 0.545.

"Also, the AI-GFCA group (Mdn = 3.8) outperformed the AI-C group (Mdn = 3.3) in the second role-play task (T2) with U = 142.00, z = − 2.559, p = 0.011, and r = 0.545."

Discussion¶

Related Claims¶

• AI-GFCA students show better pronunciation, fluency and IELTS speaking predictor scores than AI-C students, but intonation does not differ — related
• AI-GFCA students produce fewer L2 errors than AI-C students, with the advantage varying by error type and task — related