Participants held divided views on the star rating display: motivating feedback for some, a distracting oversimplification for others¶

Claim · All claims
Evidence · 1 study (2 entries) · qualitative r2–r3 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Some students and one teacher found stars motivating and treated them as feedback rather than grades. → Raigul Zheldibayeva 2025 q2 i? One teacher found the 4-star rating too simplistic and distracting, suggesting points or percentages instead. → Raigul Zheldibayeva 2025 (2)

Evidence¶

Raigul Zheldibayeva 2025¶

Raigul Zheldibayeva, Ana Karina de Oliveira Nascimento, Vania Castro, Bill Cope and Mary Kalantzis. (2025). Generative AI Feedback, English Writing and Teacher Rubrics: A Multiple-Case Study of CyberScholar. https://arxiv.org/abs/2605.17055 doi:10.48550/arxiv.2605.17055

q2 · i? · qualitative · r3

Teacher 03 (School C) post-survey in the case study; students viewed stars "as feedback" rather than grades, which the teacher reported encouraged revision without grade anxiety.

"The students were encouraged when they made revisions and saw an improvement in their score. They trusted the results and didn't see it as a grade but rather feedback."

Raigul Zheldibayeva 2025 (2)¶

Raigul Zheldibayeva, Ana Karina de Oliveira Nascimento, Vania Castro, Bill Cope and Mary Kalantzis. (2025). Generative AI Feedback, English Writing and Teacher Rubrics: A Multiple-Case Study of CyberScholar. https://arxiv.org/abs/2605.17055

q2 · i? · qualitative · r2

Teacher 02 (School B) post-survey; he called the 4-star rating "basic," suggested replacing stars with a 0-10 point or percentage scale, and worried high performers might skip reading criterion feedback.

"My students are already too distracted by the stars and not paying close enough attention to the feedback that the assistant gives."

Discussion¶

Learner Variables¶

• Attention — outcome: instruction changes it

Related Claims¶

• Some students found the automated star ratings inconsistent, receiving different scores for the same unchanged submission — related
• Reporting the number of points possible for each metric led to better understanding of how the STAR score is calculated — related
• Moving the link to the STAR framework from the top of the page to beneath the STAR score improved the school report card site's usability — related
• K-12 students across five schools valued CyberScholar's detailed, specific, rubric-aligned feedback as helpful for identifying areas to revise — related
• Concrete progress indicators and visible improvement in writing motivated students' revision engagement — related