NLP-based feedback generation for textual student answers in large courses reduced grading effort by up to 85% with high precision (reported from Bernius et al.)¶
Claim · All claims
Evidence · 1 study · theoreticalr2·q2
Currency · newest study 2023 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2026: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Grading effort in large courses could be reduced by up to 85% with high precision and improved student-perceived quality using NLP-generated feedback. → Kasneci 2023
Evidence¶
Kasneci 2023¶
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., Stadler, M., Weller, J., Kuhn, J., & Kasneci, G. (2023). ChatGPT for Good? On Opportunities and Challenges of Large Language Models for Education. https://doi.org/10.1016/j.lindif.2023.102274
q2 · i? · theoretical · r2
Narrative review attribution in Section 2.2: the paper reports Bernius et al.'s use of NLP-based models for feedback on textual student answers in large courses, with the printed figure that "grading effort could be reduced by up to 85%"; no effect size is printed.
"Bernius et al. [39] used NLP-based models to generate feedback for textual student answers in large courses, where grading effort could be reduced by up to 85% with a high precision and an improved quality perceived by the students."
Discussion¶
Related Claims¶
- A technical review reports a 70% cut in grading time and a 15% rise in learner satisfaction from NLP-based automated grading on one MOOC platform, with no comparison design described — related
- AI-supported co-produced feedback achieved comparable quality and statistically significant learning gains with reduced production time and workload — related
- GPT models achieved high polarity agreement with instructors only for positive feedback on the Topic aspect, and could not reliably assess the other rubric aspects — reports the opposite
- NLP models in LA studies typically reach moderate agreement (mean Cohen's kappa 0.54) and mean accuracy 0.79, with deep learning models outperforming others in most studies from 2021 onward — related
- Transformer-based NLP models achieve automated essay scoring with correlations to human grading exceeding 0.85 — related
- Pre-service teachers who received NLP-based adaptive feedback were better able to justify their diagnoses than those who received static feedback (reported from Sailer et al.) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
nlp-feedback-reduced-grading-effort-85-percent |
title |
NLP-based feedback generation for textual student answers in large courses reduced grading effort by up to 85% with high precision (reported from Bernius et al.) |
description |
NLP-based feedback generation for textual student answers in large courses reduced grading effort by up to 85% with high precision (reported from Bernius et al.) |
status |
review |
evidence_strength |
weak |
newest_evidence |
2023 |
source_checked |
2026-10-20 |
recheck_by |
2026 |
generated |
by process:wiki-ingest on 2026-10-15 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — kasneci-2023 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.