Deploy the card list form in rating situations where order-of-merit ranking is the only applicable method¶

Strategy · All strategies
Evidence · 3 claims (3 for) · 1 study (1 design), q1 · 0 of 1 report an effect size · 3 claims rest on one study

Description¶

The article identifies application settings for the form: "There are still a great many situations in which the order of merit method is the only one applicable," notably "experiments in mutual rating for personal traits by employees, supervisors, foremen, inspectors, teachers, etc." In the absence of objective measures of many vocational and moral traits, the form supports the best possible ranking practice in those settings.

Design Implications¶

Context¶

Requirements¶

• A setting with no objective measures of the trait and a roster of individuals to be ranked

Constraints¶

Target Learners¶

• employees, supervisors, foremen, inspectors and teachers participating in mutual-rating studies

Target Learning Goals¶

• measuring vocational and moral traits in the absence of objective tests

Claims¶

• The card list elicits ranking from judges unwilling to write names in order of merit [+W]
• Card-slip ranking produces more careful order-of-merit ratings than writing rank numbers beside names on a list [+W]
• Card-slip ranking yields a wider spread of ranks than list-based ranking typically produces [+W]

Related Strategies¶

• Use a fold-and-tear carbon duplicate form so judges sort name slips into rank order and then transcribe ranks onto the original list

Examples¶

-

Key Sources¶

• Stenquist, J. L. (1918). An Improved Form for Rating by the Order of Merit Method. The Journal of Educational Psychology. https://scholar.google.com/scholar?q=An+Improved+Form+for+Rating+by+the+Order+of+Merit+Method