Grading time varied systematically with Bloom's taxonomy category: procedural knowledge was fastest to grade and conceptual knowledge slowest¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Answers requiring procedural knowledge averaged 1.82 seconds to grade, factual knowledge 7.95 seconds, and conceptual knowledge 14.73 seconds. → Rebecka Weegar · Peter Idestam-Almquist 2024

Evidence¶

Rebecka Weegar · Peter Idestam-Almquist 2024¶

Rebecka Weegar · Peter Idestam-Almquist. (2024). Reducing Workload in Short Answer Grading Using Machine Learning. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-022-00322-1

q2 · i? · design · r2

Descriptive analysis of timed grading from the retake exam, averaging grading time per answer across the knowledge dimension of Bloom's revised taxonomy. For the cognitive process dimension, applying was fastest at 1.82 seconds, remembering averaged 10.34 seconds, and understanding averaged 13.99 seconds.

"The least time for grading was required for the procedural knowledge, 1.82 seconds on average. More time was required for an answer describing factual knowledge with 7.95 seconds on average, and the most for conceptual knowledge with 14.73 seconds on average."

Discussion¶

Related Claims¶

• University examination questions concentrate at the lower cognitive levels of Bloom's Taxonomy, dominated by comprehension and knowledge — related
• Students answer lower-taxonomy-category questions more frequently, but only by a factor of about 2 — related
• Assignments at the first five levels of Bloom's taxonomy are suited to LLM grading, while Create-level assignments are more challenging for LLMs to assess — related
• 59.14% of geriatric core competencies are classified as Apply in Bloom's cognitive process dimension and 64.2% as Conceptual Knowledge — related