Classification accuracy correlated with student performance: the classifier was more accurate on questions with more high-quality answers and less accurate where students struggled¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The classifier was more accurate with relatively more high-quality answers to learn from and less accurate for questions where students struggled. → Rebecka Weegar · Peter Idestam-Almquist 2024
Evidence¶
Rebecka Weegar · Peter Idestam-Almquist 2024¶
Rebecka Weegar · Peter Idestam-Almquist. (2024). Reducing Workload in Short Answer Grading Using Machine Learning. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-022-00322-1
q2 · i? · associational · r2
Observational finding reported in the Other Results section of the exam data set: classification performance correlated with student performance across the 64 questions. The authors suggest this was perhaps partly due to more variation among incorrect answers compared to correct answers.
"The classification performance correlated with the student performance. The classifier was more accurate with relatively more high-quality answers to learn from and less accurate for questions where the students struggled."
Discussion¶
Related Claims¶
- LLMs systematically underestimate fraction items whose difficulty is driven by misconceptions (the \"Easy Trap\") — related
- Random Forest performed slightly better overall than SVM and Complement Naive Bayes for classifying short exam answers, with an average F-score of 0.82 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
classifier-accuracy-correlates-with-student-performance |
title |
Classification accuracy correlated with student performance: the classifier was more accurate on questions with more high-quality answers and less accurate where students struggled |
description |
Classification accuracy correlated with student performance: the classifier was more accurate on questions with more high-quality answers and less accurate where students struggled |
status |
review |
evidence_strength |
weak |
newest_evidence |
2024 |
generated |
by process:wiki-ingest on 2026-10-27 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — rebecka-weegar-peter-idestam-almquist-2024 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.