Relevancy of emphasized text directs attention and influences test performance¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r? · q3
Currency · newest study 1985 · not yet checked against its sources · not reviewed by a person

Emphasis cues such as underlining do not simply boost learning overall — they shift attention toward whatever is emphasized, so test performance follows the relevancy of the marked material rather than the mere presence of marking.

Subclaims¶

q3 i? Emphasizing high-relevant material produces higher scores on questions targeting that high-relevant material. → Nist 1985

q3 i? Emphasizing low-relevant material produces higher scores on questions targeting that low-relevant material. → Nist 1985 (2)

Evidence¶

Primary evidence link: https://eric.ed.gov/?id=ED265520

Nist 1985¶

Nist, S. L., & Hogrebe, M. C. (1985). The Effects of High and Low Relevant Text Underlining on Test Performance. ERIC ED265520

q3 · peer-reviewed experiment, not pre-registered · i? · F values only, no effect size printed · n=67 · causal · r?

Sixty-seven college freshmen read text passages with underlining applied to either high-relevant or low-relevant content, then completed a test with questions matched to both relevancy levels. A weighted-means ANOVA showed a significant main effect for relevancy on the high-relevant score, F(1, 49) = 13.56, p < .01: learners performed better on high-relevant questions when that material was the emphasized content. The pattern demonstrates that emphasis directs attention to the marked material, and test performance tracks what was marked.

Nist 1985 (2)¶

Nist, S. L., & Hogrebe, M. C. (1985). The Effects of High and Low Relevant Text Underlining on Test Performance. ERIC ED265520

q3 · peer-reviewed experiment, not pre-registered · i? · F values only, no effect size printed · n=67 · causal · r?

In the same study, the main effect for relevancy was also significant for the low-relevant score, F(1, 40) = 6.98, p < .05. Learners scored higher on low-relevant questions when the low-relevant material was the emphasized content. Together with the high-relevant result, emphasis raised scores on whichever material was emphasized; that the effect is symmetric, of equal size regardless of the material's instructional importance, is not shown by the two F tests printed (unsourced on this page).

Studies bearing on this claim¶

Does it matter what is marked, and who marks it (learner or instructor)? This table gathers the studies behind this claim and the 10 narrower claims that bear on it: 6 distinct studies (4 causal, 2 review), q2–q3, 2 of 6 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

Attention follows marking, not importance. The two findings combine into a single mechanism: emphasis acts as an attention cue, and learners allocate study time and processing to cued content. This is double-edged. Marking the right content scaffolds selective attention and improves outcomes; marking the wrong content misdirects attention away from what matters, producing the same measurable shift toward trivial material. This aligns with the broader coherence finding that irrelevant material hurts learning — see Irrelevant material hurts learning (coherence principle). [+M]

Design implication. The relevancy of instructor-provided emphasis is a design decision with direct assessment consequences. Textbook highlighting, slide emphasis, and pre-annotated readings should mark content that maps onto intended learning outcomes, not decorative or incidental detail. For learner-generated marking, the quality of what students choose to underline matters as much as the act of marking — see Annotating improves learning. [+M]

Boundary conditions. Both subclaims rest on one experiment with 67 college freshmen reading expository text with underlining as the emphasis device. Generalization to other marking formats (bolding, color), other populations, and longer or more complex texts is not yet established. No effect size is printed (only F values), and outcomes were measured immediately; durability of the attention-shift effect over delay is untested here.

Related Claims¶

• Coherence Principle Irrelevant Material Hurts Learning — the general claim this finding bears on, with the studies behind it

• Annotating improves learning. — learner-generated marking interacts with the relevancy of what is marked

• Irrelevant material hurts learning (coherence principle). — emphasis on low-relevant content is a form of irrelevant material competing for attention
• Chunking reduces working memory load. — selective emphasis helps learners chunk the most relevant content first
• Von Restorff effect and text marking. — distinctiveness of marking underlies the attention shift
• Highlighting shows low utility for improving learning outcomes — related
• Classroom interactional structures such as questions, recasts, and feedback influence students' processing of targeted content — related
• Prior knowledge is not significantly related to test performance in this sample — related
• Students' prior knowledge about a topic impacts their understanding of text as they read — related
• Ten-year-old readers predominantly underline subordinate passage details rather than superordinate conceptual material, even when conceptual postquestions focus attention on topic sentences — related
• Pre-reading relevance instructions did not change reading time on sentences targeted by the questions — related
• In one experiment, students who generated their own underlining did not score significantly higher on tests than students given experimenter-generated underlining — related
• Signaling principle: highlighting essential words improves transfer from multimedia lessons — a broader claim this one bears on
• Audio narration with finger-tracking animation directs bilingual preschoolers' attention to the target-language print in dual-language e-books, including the nondominant language — a narrower finding that bears on this claim
• Recall of passage details is most depressed when children receive both underlining and conceptual postquestions — related
• Structuring worked examples to emphasize subgoals, via labels or visual segmentation, enhances transfer to novel problems — a narrower finding that bears on this claim
• Engagement via annotation (underlining, highlighting, notes) shows no significant effect on comprehension — related