Rankings of the same 120 junior high pupils by the Otis and Illinois group intelligence tests disagreed by a median of 18 places, with a rank correlation of 0.642¶

Claim · All claims
Evidence · 1 study · associational r1 · q2
Currency · newest study 1921 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? When 120 junior high school pupils were ranked on the Otis Intelligence Test and the intelligence division of the Illinois Examination, the median change of rank between tests was 18 places and the rank-difference correlation was 0.642. → Geyer 1921

Evidence¶

Geyer 1921¶

Geyer, D. L. (1921). The Reliability of Rankings by Group Intelligence Tests. The Journal of Educational Psychology. https://www.jstor.org/journal/jeduapsy

q2 · i? · associational · r1

Observational comparison of two group tests given by the same person to 120 junior high school pupils at the Chicago Normal School during 1919 and 1920. The article reports the "median change of rank from one test to the other was found to be 18 places" and a rank-difference correlation of 0.642.

"the median change of rank from one test to the other was found to be 18 places. The maximum change which could have been effected throughout the group was 60 places and the change left to chance would be 40 places."

Discussion¶

Related Claims¶

• The author concludes that much remains to be done before group intelligence tests can be fully relied upon for trustworthy placing of individual pupils — a broader claim this one bears on
• Group intelligence scores correlated only modestly with school marks (freshmen: 0.41 Thurstone, 0.56 Brown; junior high: 0.25 Illinois, 0.32 Otis), which the author attributes to marks depending on many non-intelligence factors — related
• Dividing the 120 pupils into four class-sections by one test would place 51.6 per cent in the wrong section according to the other test — a narrower finding that bears on this claim
• Correlations between two forms of the same test (up to 0.94, averaging 0.83 in Colvin's data) far exceed between-test correlations, casting doubt that different 'general intelligence tests' measure the same element — a broader claim this one bears on
• Otis scores proved of practical value over a two-year trial for guiding junior high pupils' choice between a foreign language and manual work — related
• Thurstone-Brown agreement was closer than Otis-Illinois: median rank changes of 6.7 places (freshmen, r = 0.74) and 10.4 places (sophomores, r = 0.613), with 26 and 32.8 per cent wrongly classed — related