Sort papers to be rated into piles of approximately equal value before scoring against the scale¶

Strategy · All strategies
Evidence · 1 claim (1 for) · 1 study (1 design), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

A rating procedure for objective scales in which the rater first groups drawings into piles of similar quality before assigning scale values. The author writes that those using the scale will find it helpful to "sort the papers to be rated into piles such that the papers of any one pile shall be of approximately equal value and perceptibly different from those of the piles of nearest value." This gives the rater a double set of comparisons and permits faster work using only a limited range of the scale for each pile.

Design Implications¶

Context¶

Requirements¶

• A set of papers to be rated and an objective scale with samples spanning the quality range

Constraints¶

Target Learners¶

• Teachers, supervisors, and judges rating pupil drawings

Target Learning Goals¶

• Accurate and efficient rating of drawing achievement

Claims¶

• Gaps in the scale's sample range produce distribution anomalies, with fewer ratings in the 4 to 4.99 band than in the 3 to 3.99 band [+W]

Related Strategies¶

Examples¶

-

Key Sources¶

• Childs, H. G. (1915). Measurement of the drawing ability of two thousand one hundred and seventy-seven children in Indiana city school systems by a supplemented Thorndike scale. The Journal of Educational Psychology, 6(7), 391-408. https://doi.org/10.1037/h0075575