Free-response improvement comments differed by format: stiffness of speech dominated for teacher–teacher and unnatural manner of speaking for student–student¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In the TT format, stiffness of speech (frequency 8) was the most common improvement label, with difficulty of content and abundance of difficult vocabulary also emerging; in the SS format, unnatural manner of speaking (frequency 14) was most common. → Fumie Watanabe 2026

Evidence¶

Fumie Watanabe 2026¶

Fumie Watanabe, Tota Suko, Takashi Ishida, Yuko Kuma, Manabu Kobayashi, Shigeichi Hirasawa, and Gendo Kumoi. (2026). Interaction Effects Between Learner Characteristics and Dialogue Format in TTS Dialogue-Based Lessons. https://arxiv.org/abs/2608.20822 doi:10.48550/arxiv.2608.20822

q2 · i? · causal · r1

Qualitative coding (KJ method with LLM-assisted labeling, Cohen's κ = .952) of optional free-response comments from 49 students (22.1%) for TS, 44 (19.8%) for SS, and 46 (20.7%) for TT, yielding 26 distinct labels. In the SS format, "unnatural manner of speaking" (frequency 14) was the most common label.

"In the TT format, "stiffness of speech" (frequency 8) was the most common label, and "difficulty of content" and "abundance of difficult vocabulary" also emerged as distinct labels"

Discussion¶

Related Claims¶

• Students most frequently attribute fluency and pronunciation gains to games — related
• Student–student and teacher–teacher dialogue formats elicited significantly higher ARCS motivation than the teacher–student format — related
• The teacher–teacher format received a significantly lower overall evaluation than the teacher–student format despite raising motivation, with no significant learner-characteristic interactions — related