Introduce Evaluation Concepts¶

Strategy · All strategies
Evidence · 4 claims (3 for, 1 against) · 9 studies (7 causal, 2 quant-synthesis), q2–q4 · 3 of 9 report an effect size

Description¶

This strategy gives learners a shared vocabulary for judging information quality — terms such as relevance, accuracy, bias, reliability, and credibility — and then uses those terms routinely in discussion, reading, and assessment. The goal is to move source evaluation from an occasional activity to a habitual stance: learners come to ask, by default, who produced a source, why, and how well it supports the claim at hand.

Design Implications¶

Naming and repeatedly applying evaluation criteria converts tacit "gut feelings" about sources into explicit, teachable judgments. Critical-thinking instruction is most effective when it is embedded in subject content and involves explicit criteria plus guided practice, rather than generic reasoning drills Explicit instruction embedded in domain content improves critical-thinking outcomes. [+S]. The vocabulary itself is only the entry point: concepts become durable when learners apply them to real sources repeatedly, with feedback, across varied contexts Conceptual knowledge applied across multiple varied cases supports transfer. [+M].

Context¶

Requirements¶

• Explicit Direct Instruction of each concept with a clear definition, a worked example, and a Non-Examples contrast (e.g., a reliable vs. a biased account of the same event)
• Authentic sources to analyze — primary documents, news articles, social media posts — not invented textbook examples
• Regular integration into discourse: the terms must appear in Class Discussion, reading prompts, and Assessment criteria, not just in one introductory lesson
• Scaffolding that fades: from teacher-led analysis, to guided group analysis, to independent evaluation

Constraints¶

• A one-off vocabulary lesson does not produce transfer; without repeated application across contexts, learners revert to accepting sources at face value Civic online reasoning instruction improves evaluation only when taught with repeated practice on live sources. [-W]
• Learners may apply the terms superficially — labeling everything "biased" without justification — if criteria are not tied to evidence-gathering routines
• Novices can experience cognitive overload [-M] when asked to evaluate a source on many dimensions at once; introduce criteria incrementally
• Concept knowledge alone does not guarantee skilled evaluation; strategy instruction (e.g., checking who is behind a site) outperforms definitional knowledge for online sources Civic online reasoning instruction improves evaluation. [+S]

Implementation Variability¶

• Discipline-specific framing: historians emphasize sourcing and corroboration; scientists emphasize methodology and replication; media studies emphasize framing and audience
• Age adaptation: younger learners use simplified criteria ("Who made this? Why? Is it true?"); older learners use full credibility frameworks
• Depth variation: from quick heuristic checklists to full Case Studies analyzing contested events with multiple conflicting sources

Target Learners¶

• Middle and high school students encountering primary and secondary sources for the first time Civic online reasoning instruction improves evaluation. [+S]
• Learners with limited prior exposure to media literacy, who tend to judge credibility by surface features (design, tone) rather than evidence Civic online reasoning instruction improves evaluation. [+M]
• Less effective without adaptation for very young learners, who lack the background knowledge to judge accuracy or detect bias meaningfully

Target Learning Goals¶

• Critical evaluation: judging the relevance, accuracy, and reliability of information sources
• Epistemic cognition: understanding that authors have motivations and perspectives that shape texts
• Disciplinary literacy: applying domain-specific sourcing norms (e.g., corroboration in history) Disciplinary literacy instruction improves comprehension. [+M]

Instructions¶

1. Name and define each concept with an example and a Non-Examples contrast, using Direct Instruction.
2. Model an evaluation aloud on a live source, verbalizing the criteria in use (Think-Aloud).
3. Guide whole-class application during Class Discussion, requiring learners to justify judgments with the shared vocabulary.
4. Move to small-group analysis of conflicting sources (Case Studies), then to independent evaluation with Assessment rubrics that score use of the criteria.
5. Fade support over time (Scaffolding), so evaluation terms become self-initiated habits rather than teacher prompts.

Related Strategies¶

• A Finder's Guide to Facts — a companion routine for checking facts that operationalizes these evaluation concepts
• Activating Prior Knowledge — learners' existing beliefs about sources shape how they apply evaluation criteria

Examples¶

• A history teacher introduces relevance, accuracy, bias, and reliability when comparing a government communiqué and a soldier's letter about the same battle, then requires students to use the terms in every subsequent document analysis.
• The Stanford History Education Group's Civic Online Reasoning curriculum teaches evaluation concepts through short lessons in which students judge real websites, tweets, and news articles, with practice items scored against explicit criteria.
• A science teacher applies the same vocabulary to evaluating claims about a controversial study, asking whether the source is reliable (peer-reviewed?) and whether reporting is accurate relative to the original paper.

Key Sources¶

• Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015). Strategies for teaching students to think critically: A meta-analysis. Review of Educational Research, 85(2), 275–314. doi:10.3102/0034654314551063
• Wineburg, S., & McGrew, S. (2019). Lateral reading and the nature of expertise: Reading less and learning more when evaluating digital information. Teachers College Record, 121(11). doi:10.1177/016146811912101102
• Breakstone, J., Smith, M., Wineburg, S., Lester, J., & Ortega, T. (2018). Why we need a new approach to teaching digital literacy. Phi Delta Kappan, 99(6), 27–32. doi:10.1177/0031721718762419
• Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction (The Delphi Report). California Academic Press.