No significant relationship exists between essay quality and the overall quality of feedback generated by peers and ChatGPT¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Spearman's correlation showed no significant overall relationship between essay writing quality and feedback quality from either peers or ChatGPT. → Banihashem 2024

Evidence¶

Banihashem 2024¶

Banihashem, S. K., Taghizadeh Kerman, N., Noroozi, O., Moon, J., & Drachsler, H. (2024). Feedback sources in essay writing: peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education. https://doi.org/10.1186/s41239-024-00455-4

q2 · i? · associational · r2

Spearman's correlation analysis relating essay quality (coded on eight argumentative elements) to overall feedback quality from peers and ChatGPT. No significant overall relationship was found; equivalence was not tested and no overall effect size is printed.

"Overall, the results indicated that there was no significant relationship between the quality of essay writing and the feedback generated by peers and ChatGPT."

Discussion¶

Related Claims¶

• Essay quality correlates positively with the affective feature of ChatGPT feedback and negatively with the affective feature of peer feedback — related
• ChatGPT feedback quality varied by essay quality: accuracy declined as essay quality rose, prioritization was best for average essays, and supportive tone was lowest for low-quality essays — reports the opposite
• ChatGPT produced more descriptive feedback than peers on argumentative essays — related
• In the first assessment stage, peer group and ChatGPT-4o feedback showed no significant difference in quality — related