Benchmarking shows NLP-based automated essay scoring achieves grading times up to 80% faster than human graders while maintaining comparable accuracy¶

Claim · All claims
Evidence · 1 study (2 entries) · review r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q2 i? Against traditional LMS baselines with manual grading, NLP-based automated essay scoring achieves grading times up to 80% faster than human graders while maintaining comparable accuracy. → Mahamad 2025 q2 i? ML-driven recommendation systems improve learner retention by 15–20% compared to static content delivery. → Mahamad 2025 (2)

Evidence¶

Mahamad 2025¶

Mahamad, S.; Chin, Y.H.; Zulmuksah, N.I.N.; Haque, M.M.; Shaheen, M.; Nisar, K. (2025). Technical Review: Architecting an AI-Driven Decision Support System for Enhanced Online Learning and Assessment. Future Internet 2025, 17, 383. https://doi.org/10.3390/fi17090383

q2 · i? · review · r2

The review's benchmarking section compares AI-DSSs against non-AI baselines such as traditional LMSs with manual grading, reporting "grading times up to 80% faster than human graders while maintaining comparable accuracy". No standardized effect size is printed.

"NLP-based automated essay scoring achieves grading times up to 80% faster than human graders while maintaining comparable accuracy [93]."

Mahamad 2025 (2)¶

Mahamad, S.; Chin, Y.H.; Zulmuksah, N.I.N.; Haque, M.M.; Shaheen, M.; Nisar, K. (2025). Technical Review: Architecting an AI-Driven Decision Support System for Enhanced Online Learning and Assessment. Future Internet 2025, 17, 383. https://doi.org/10.3390/fi17090383

q2 · i? · review · r2

Same benchmarking section: "ML-driven recommendation systems improve learner retention by 15–20% compared to static content delivery". No standardized effect size is printed.

"Similarly, ML-driven recommendation systems improve learner retention by 15–20% compared to static content delivery [76]."

Discussion¶

Related Claims¶

• Transformer-based NLP models achieve automated essay scoring with correlations to human grading exceeding 0.85 — related
• A technical review reports a 70% cut in grading time and a 15% rise in learner satisfaction from NLP-based automated grading on one MOOC platform, with no comparison design described — a narrower finding that bears on this claim
• NLP models in LA studies typically reach moderate agreement (mean Cohen's kappa 0.54) and mean accuracy 0.79, with deep learning models outperforming others in most studies from 2021 onward — related
• Agentic assessment systems report grading time reductions of 50–70% with 90–95% agreement with human graders — related
• Praxical teacher-AI grading teaming decreased grading time by 44% and increased accuracy by 6% versus manual grading — related