Directly prompted Claude 3.7 micro-level deep feedback was judged both necessary and effective in 94.69% of 630 comments¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Of 630 micro feedback comments from Claude 3.7, 600 were finalized as necessary (95.24%) and 596 of those as effective, yielding 94.69% both necessary and effective. → Adnan Labib 2026

Evidence¶

Adnan Labib 2026¶

Adnan Labib, Yixuan Huang, Jiahui Wu, John Maurice Gayed, Zheng Yuan, Qiao Wang. (2026). WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays. arXiv preprint. https://arxiv.org/abs/2607.14524 doi:10.48550/arxiv.2607.14524

q2 · i? · design · r2

Human evaluation of Claude 3.7 micro feedback on the same 40 essays, rated on necessity and effectiveness by two raters with third-rater resolution; inter-rater agreement was AC1 = 0.91 for necessity and AC1 = 1.00 for effectiveness (both p <.001).

"Among the necessary comments, 596 were deemed effective while 4 were ineffective, and thus the proportion of both necessary and effective comments is 94.69%."

Discussion¶

Related Claims¶

• Directly prompted Claude 3.7 macro-level deep feedback was judged effective for 93.03% of 201 paragraph-level comments — related
• In one essay-feedback system, fine-tuned models produced no usable deep-level feedback output, so only directly prompted LLMs were evaluated; the authors suggest prompting may be more effective than supervised fine-tuning for this task — related
• Directly prompted GPT-4o surface-level corrective edits were judged necessary and effective in 96.14% of 2049 identified edits — related
• Existing AI × SEL policy claims concentrate at macro and meso levels, with almost none at the classroom level — related