For revealing_answer, pedagogically undesired feedback achieves higher SuccScore in both semesters, suggesting success via copying revealed answers¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? revealing_answer is the only pedagogical dimension where the pattern reverses: undesired feedback achieves higher mean SuccScore than desired feedback under both tutors (67.8% vs. 50.9% for BaselineTutor; 79.4% vs. 53.0% for MisconceptionTutor). → Rose Niousha 2026

Evidence¶

Rose Niousha 2026¶

Rose Niousha, Samantha Boatright Smith, Bita Akram, Peter Brusilovsky, Arto Hellas, Juho Leinonen, John DeNero, and Narges Norouzi. (2026). The Missing Evaluation Axis: What 10,000 Student Submissions Reveal About AI Tutor Effectiveness. arXiv preprint. https://arxiv.org/abs/2605.05648 doi:10.48550/arxiv.2605.05648

q2 · i? · associational · r2

Fig. 3 analysis of SuccScore by pedagogical dimension across both semesters; the quote reports the reversed pattern for revealing_answer with printed percentages for both tutors.

"ForBaselineTutor, feedback marked as un-desired inrevealing_answerachieves a higher meanSuccScore(67.8%) than desired feedback (50.9%), and a similar pattern appears inMisconceptionTutor(79.4% vs. 53.0%)"

Discussion¶

Related Claims¶

• Engagement-based metrics are more robust predictors of students' perceived feedback helpfulness than pedagogical dimensions — related
• MisconceptionTutor achieves higher pedagogical quality (DAMR) than BaselineTutor on nearly all dimensions, with small-to-moderate effect sizes — related
• Pedagogically desired feedback is engaged with more (higher RelScore), but pedagogical quality shows little relation to whether actions are applied correctly (SuccScore) — related
• Single-turn tutors disclose answers pervasively while challenge scores are near zero across every model and subject — related
• MisconceptionTutor achieves substantially higher feedback relevance (RelScore) than BaselineTutor on every assignment — related