Analytic grades matched expert criteria more often for weak essays while holistic grades did so for strong essays¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? For weak essays, more participants' analytic grades fell within expert-acceptable ranges than holistic grades (54.1% vs. 46.7%); for strong essays the pattern reversed slightly (44.6% holistic vs. 39.8% analytic). → Lopera-Oquendo 2024

Evidence¶

Lopera-Oquendo 2024¶

Lopera-Oquendo, C., Lipnevich, A. A., & Mañez, I. (2024). Rating writing: Comparison of holistic and analytic grading approaches in pre-service teachers. Learning and Instruction, 94, 101992. https://doi.org/10.1016/j.learninstruc.2024.101992

q2 · i? · causal · r1

Consensus-agreement analysis defined agreement as grades within researcher-set expert ranges; the described analytic advantage for weak essays (54.1% vs. 46.7%) reversed for strong essays.

"a higher proportion of participants provided analytic grades consistent with the expert benchmark in comparison to holistic grades in the weak essays (54.1% vs. 46.7%). For the strong essay, the proportion of pre-service teachers who provided scores in agreement with expert criteria was slightly higher in the holistic approach (44.6% vs. 39.8%)."

Discussion¶

Related Claims¶

• Pre-service teachers show high intra-rater consistency between holistic and analytic grades for the same essays — related