Judgments of comprehension in oral reading rest on unaided subjective judgment with no guarantee of consistency across times or judges¶

Claim · All claims
Evidence · 1 study · theoretical r2 · q1
Currency · newest study 1919 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q1 i? The most serious drawback of judging comprehension from oral reading is that estimates rest entirely on the unaided subjective judgment of the listener, with no guarantee that evaluations are stable across times or judges. → J. C. Bell 1919

Evidence¶

J. C. Bell 1919¶

J. C. Bell. (1919). Problems in Reading. The Journal of Educational Psychology, Volume X, Number 8. https://psycnet.apa.org/journal/edu

q1 · i? · theoretical · r2

Editorial argument about teacher judgments of children's oral reading; the author also notes oral reading demands individual testing, costlier in time than group testing, and no data are reported.

"the estimates of quality of compre- hension rest entirely upon the unaided subjective judgment of the listener, and we have no guarantee that the evaluation of the same reading will be the same at different times, or that two judges have the same standards."

Discussion¶

Related Claims¶

• Teachers often rely on informal impressions rather than systematic, theory-grounded diagnostic procedures when judging students' SRL — related
• Agreement metrics and expert quality judgments diverge in both directions: human consensus can encode shared conservative bias that the verifier rejects in favor of LLM coding — related