Independent grading by eight judges of 34 specimens showed average deviations below the 10-point scale spacing (average 6.1), supporting the scale's objectivity¶

Claim · All claims
Evidence · 1 study · associational r2 · q2
Currency · newest study 1912 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Eight judges grading the same 34 specimens independently deviated from their common average by less than the scale's 10-point spacing in all but one case, averaging 6.1. → King 1912

Evidence¶

King 1912¶

King, I., & Johnson, H. (1912). The writing abilities of the elementary and grammar school pupils of a city school system measured by the Ayres scale. Journal of Educational Psychology, 3(9), 514–520. doi:10.1037/h0071006

q2 · i? · associational · r2

Reliability substudy: 34 specimens taken at random from the collection were graded independently by eight competent judges. Because scale specimens are placed 10 points apart, the authors take the 6.1 average deviation to mean subjectivity "may be reduced to a small quantity."

"in every case but one the average of the deviations of the eight judges is below 10 and the average, of these average deviations is only 6.1."

Discussion¶

Related Claims¶

• Grading of handwriting samples with the Ayres scale by a single judge shows steady improvement across grades, with dips at 5B and 8A — related
• Automated judging aligns strongly with three domain experts (r = 0.82 for role fidelity) but exhibits a conservative bias, scoring ethical deviation 0.08 points lower than humans — related
• AI grading of the exam is highly stable across five independent runs at the total-score level (ICC(A,1) = 0.967), with lower but still strong cell-level stability (ICC(A,1) = 0.836) — related