High school teachers' rankings of algebra problem difficulty were uncorrelated with student performance, while middle school teachers' rankings were accurate¶
Claim · All claims
Evidence · 1 study (2 entries) · theoreticalr2·q3
Currency · newest study 2001 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? High school teachers (n = 39) judged verbal problems, especially algebra story problems, as most difficult for students, and their rankings showed no relation to student performance (τ(6) = 0). → Nathan 2001
q3 i? Middle school teachers (n = 30) predicted students would find story and word problems easiest and were very accurate in predicting student performance, τ(6) = .733, p = .034. → Nathan 2001 (2)
Evidence¶
Nathan 2001¶
Nathan, M. J., Koedinger, K. R., & Alibali, M. W. (2001). Expert Blind Spot: When Content Knowledge Eclipses Pedagogical Content Knowledge. Proceeding of the Third International Conference on Cognitive Science. https://www.google.com/search?q=%22Expert+Blind+Spot%22+Nathan+Koedinger+Alibali
q3 · i? · theoretical · r2
Ranking task with 105 elementary, middle and high school teachers who ordered problems from easiest to most difficult; problems varied along arithmetic/algebraic and verbal/symbolic dimensions. The article reports the high school teachers' ranking was "not related to student performance at all, τ(6) = 0"; no effect size is printed.
"However, the ranking provided by high school teachers was not related to student performance at all, τ(6) = 0, providing further support for the EBS hypothesis."
Nathan 2001 (2)¶
Nathan, M. J., Koedinger, K. R., & Alibali, M. W. (2001). Expert Blind Spot: When Content Knowledge Eclipses Pedagogical Content Knowledge. Proceeding of the Third International Conference on Cognitive Science. https://www.google.com/search?q=%22Expert+Blind+Spot%22+Nathan+Koedinger+Alibali
q3 · i? · theoretical · r2
In the same ranking task, middle school teachers with less post-secondary mathematics education predicted story and word problems would be easiest and were "very accurate in predicting student performance, τ(6) = .733, p = .034"; no effect size is printed.
"Middle school teachers were very accurate in predicting student performance, τ(6) = .733, p = .034."
Discussion¶
Related Claims¶
- Students' difficulty rankings of equation types partly mismatch their measured performance, though metacognitive accuracy improves with age
- Equations of the form a/x = b are the most difficult equation type, reflecting procedural complexity
- In Grossman's case study, English teachers without formal teacher education adopted text-centered instruction, while teacher education graduates adopted student-centered instruction
- Ramp task levels are ordered by difficulty: performance declines as the number of variables to set increases — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
high-school-teacher-rankings-uncorrelated-student-performance |
title |
High school teachers' rankings of algebra problem difficulty were uncorrelated with student performance, while middle school teachers' rankings were accurate |
description |
High school teachers' rankings of algebra problem difficulty were uncorrelated with student performance, while middle school teachers' rankings were accurate |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2001 |
generated |
by process:wiki-ingest on 2026-10-16 |
trust |
unverified — no one has confirmed this page's content |
sources |
2 — nathan-2001, nathan-2001-2 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.