Typical verbal achievement tests may underestimate students' subject-matter knowledge because of a mismatch between the test's symbolic form and students' symbolic encoding¶

Claim · All claims
Evidence · 1 study · review r2 · q1
Currency · newest study 1986 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 1989: tool and model accuracy changes quickly
Evidence quality · No study behind this claim is a peer-reviewed article with a DOI: it rests on an ERIC document (a report, conference paper or thesis). It is kept because 7 design pages cite it; treat it as a lead to check, not an established finding.

Subclaims¶

q1 i? Achievement tests presented in a predominantly verbal code may place irrelevant demands on test takers and underestimate some students' subject-matter knowledge. → Shavelson 1986

Evidence¶

Shavelson 1986¶

Shavelson, Richard J.; Webb, Noreen M.; Lehman, Penny. (1986). The Role of Symbol Systems in Problem Solving: A Literature Review. CSE Report No. 269. https://eric.ed.gov/?id=ED338680

q1 · i? · review · r2

Theoretical argument advanced in the review's problem statement: because instruction is dominated by verbal symbols and students encode specifically, typical objective tests "may underestimate students' subject-matterknowledge". The review offers this as a contention to be examined, not a tested result.

"current achievement tests may underestimate students' subject-matterknowledge and problem solving ability because ofthe mismatch between the symbolic form typical achievement testsuse and the specificity of students' symbolic encoding"

Discussion¶

Related Claims¶

• Proposition 4: evidence gathered through distinct demands supports capability claims better than multiple records of the same performance — the general claim this finding bears on, with the studies behind it
• People acquire different knowledge from different media, the closest indirect evidence for symbolic encoding specificity — related
• Research on minority group testing has focused on test bias, linguistic minorities, and culture-fair tests, rarely on alternative symbolic forms — related
• Recall from bar graphs is more accurate when the recall format matches the studied graph format, a small effect that the content's thematic emphasis can override — related
• Adding relevant pictures or graphics to text improves learning from it, with a small pooled effect on reading comprehension, though whether dual coding explains the benefit is disputed — related
• Multiple representations improve learning — related
• Dahmus Method students translated phrases successfully but failed to combine them into a single solution equation — a narrower finding that bears on this claim
• Demanding excellence for the many rather than the few is questionable, and academic excellence defined as test success is too narrow — related
• Learning with multiple representations imposes high demands and often fails to produce expected results because learners do not integrate the representations — related
• Ninth grade algebra students solve verbally presented problems better than symbolically presented problems — related