Students perceived the automated personalized feedback as too general and lacking personal response¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2016 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2019: tool and model accuracy changes quickly

Subclaims¶

q2 i? In the same evaluation, students reported a lack of personal response and found the automated feedback too general, indicating a need for adjustments to feedback messages, navigation and graphic design. → van der Schaaf 2016

Evidence¶

van der Schaaf 2016¶

van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E., Badii, A., Serban, O., Ten Cate, O. (2016). Improving workplace-based assessment and feedback by an E-portfolio enhanced with learning analytics. Education Tech Research Dev. https://doi.org/10.1007/s11423-016-9496-8

q2 · i? · design · r2

Descriptive analysis of the usability questionnaire responses from the 121 students and 30 supervisors participating in the phase-5 evaluation. Students were positive about supervisors' narrative feedback and visualization options but criticized the automated feedback; the article reports "the need for adjustments to improve the users' experience".

"Regarding the automated feedback students felt a lack of personal response and in some cases the automated feedback was perceived to be too general (i.e., the same feedback could be interpreted in different ways by students)."

Discussion¶

Related Claims¶

• Business Writing students valued AI feedback for higher-order and sentence-level comments but found it sometimes too general, while appreciating peers' contextual knowledge — a broader claim this one bears on
• Students perceived peer group feedback as contextually rich but sometimes subjective, and ChatGPT-4o feedback as more objective and well structured but occasionally lacking contextual sensitivity — related
• Students identified lack of sensitivity to linguistic nuance as a limitation of AWA feedback — related
• LLM-generated feedback is more comprehensive in volume than human feedback but is sometimes too generic, abstract, or misaligned with the assigned grade — a broader claim this one bears on
• Students and supervisors in medical, veterinary and teacher education perceived the learning-analytics-enhanced E-portfolio as useful for monitoring professional development — related
• Students report that feedback in DPBL is occasionally lacking despite general contentment with tasks — related