Resource Evaluation¶
Element · All elements
Evidence · 19 claims (10 for, 7 mixed, 2 against) · 24 studies (12 causal, 4 review, 3 quant-synthesis, 2 qualitative, 2 theoretical, 1 associational),q1–q4· 3 of 24 report an effect size · 15 claims rest on one study
Description¶
Resource evaluation asks learners to judge the credibility, accuracy, and relevance of information sources before using them. Rather than treating evaluation as a checklist delivered by the instructor, learners apply criteria themselves — comparing sources, probing authorship and evidence, and justifying their judgments — which builds transferable information literacy.
Design Implications¶
Resource evaluation works when learners actively apply criteria to real, contrasting sources rather than memorizing a rubric. Professional fact-checkers outperform academics by lateral reading — leaving a page to investigate the source elsewhere — and teaching this strategy explicitly improves students' evaluative judgments (Wineburg & McGrew, 2019) [+S]. Evaluation tasks also deepen content learning: prompting readers to attend to source features (author, purpose, corroboration) improves their ability to integrate multiple documents (Braasch et al., 2013) [+M]. Structured comparison of credible and non-credible sources supports abstraction of the underlying criteria Multiple contrasting cases help learners abstract general principles. [+M].
Context¶
Requirements¶
- A source set that includes genuinely contrasting quality — credible, biased, and unreliable sources on the same topic
- Explicit evaluation criteria co-developed or operationalized by learners (Criteria Development), not just handed over
- A product that requires justification of judgments (annotated bibliography, source memo, verdict with evidence)
- Instructor feedback on evaluative reasoning, since novices often overweight surface features like domain extension or design polish (Wineburg & McGrew, 2019) [~M]
Constraints¶
- Checklist approaches (e.g., applying the CRAAP test mechanically) can produce false confidence: learners "pass" manipulated or biased sources that satisfy surface criteria (Wineburg & McGrew, 2019) [-M]
- Ineffective when all provided sources are pre-vetted and credible — learners never practice discrimination
- High working-memory demand when learners must evaluate content and source credibility simultaneously; scaffolds or chunking of the task are needed Chunking reduces working memory load. [~M]
- Prior topic knowledge can bias evaluation — learners rate congenial sources as more credible regardless of quality (Braasch et al., 2013) [~M]
Target Learners¶
- Undergraduate and graduate students in research-heavy disciplines and academic writing courses
- Secondary students in media literacy programs, who show large gains from explicit strategy instruction (Wineburg & McGrew, 2019) [+S]
- Less effective for learners with no baseline content knowledge, who cannot judge plausibility of claims and rely entirely on surface cues [~W]
Target Learning Goals¶
- Information literacy: judging source credibility, bias, and provenance
- Critical analysis: evaluating evidence quality and argument support
- Epistemic cognition: understanding how knowledge claims are produced and contested
- Multiple-document comprehension: corroborating and reconciling conflicting accounts (Braasch et al., 2013) [+M]
Affordances¶
- Metacognition — evaluating sources forces learners to monitor their own reasoning ("Why do I trust this?"), and articulating those judgments improves conceptual understanding of both the criteria and the content Self-explanation improves conceptual understanding. [+M]
- Inquiry-Based Learning — evaluation is the quality-control step of inquiry; without it, learner-generated questions lead to uncritical source dumping
- Cognitive Apprenticeship — instructor modeling of expert evaluation moves (lateral reading, source triangulation) makes invisible disciplinary judgments observable before learners attempt their own
- Active Learning — learners produce verdicts and justifications rather than receiving a list of approved sources
Claims¶
- Some children in a K-8 school study used a 'trust test' strategy, asking a chatbot questions they already knew the answers to, to evaluate it as a credible information source [+W]
- ChatGPT users differentiated information less (never by credibility) and rarely verified information compared to Google users [-W]
- AI hallucination can be turned into a pedagogical resource by making verification and collaborative fact evaluation integral to AI-supported learning [~W]
- Large language models can produce fluent but factually inaccurate or fabricated outputs (AI hallucination), posing risks for uncritical users in science education [+W]
- College students' scores on an online source credibility assessment improved significantly after four course-embedded modules in an asynchronous nutrition course [+M] — attached 2026-10-15 from Breakstone et al. (2021), which proposed "Four one-hour course-embedded modules teaching fact checkers' evaluation strategies in an asynchronous nutrition course"; tests this page's relationship.
- After the modules, students engaged in lateral reading far more often, rising from 3 of 87 students at pretest to 67 of 87 at posttest [+M] — attached 2026-10-15 from Breakstone et al. (2021), which proposed "Four one-hour course-embedded modules teaching fact checkers' evaluation strategies in an asynchronous nutrition course"; tests this page's relationship.
- Students most commonly cited authorial credentials and publication type as credibility cues [~W]
- High school students used Google page rank as a first-order heuristic for relevance [+W]
- Embedded-source trustworthiness evaluations do not change across positions when both document sources have similar trustworthiness [~W]
- Online reading for academic purposes is a complex activity involving analysing task requirements, assessing information needs, accessing relevant contents, and evaluating relevance and reliability of information. [+W]
- Embedded-source trustworthiness evaluations shift toward the trustworthiness of the most recent document source in mixed sequences [~W]
- Review-attributed evidence: fabricated model-generated references clustered in disciplinary journals in a student verification exercise [~W]
- Embedded-source and document-source trustworthiness scores differed, suggesting an interplay between layers rather than one-layered reflection [~W]
- Middle-schoolers judge a speaker presented as a researcher as more expert and more trustworthy than one presented as a consumer [+W]
- Pre-service teachers rate ChatGPT-generated texts higher on structure but often fail to identify AI authorship, indicating limited critical AI literacy [-W]
The evidence by question¶
- Does teaching learners how to check a source improve their judgments of unfamiliar sources, and how much can one session do? Civic Online Reasoning Instruction Improves Evaluation [+S]
- Do learners check information from a generative AI the way they check sources found by search? ChatGPT users differentiated information less (never by credibility) and rarely verified information compared to Google users [+M]
Related Elements¶
- Research — evaluation is the filtering stage within a research cycle
- Criteria Development — co-constructing rubrics makes evaluation criteria explicit and owned by learners
- Case Studies — real-world cases supply authentic, messy source sets for evaluation practice
- Class Discussion — comparing evaluative judgments across learners surfaces divergent criteria
Patterns That Use This Element¶
- Inquiry-Based Learning — evaluation gates which evidence enters the inquiry
- Research-Based Learning — credibility judgments determine the evidentiary base of student research products
- Case-Based Learning — cases require judging the reliability of embedded documents and testimony
Examples¶
Stanford History Education Group — Civic Online Reasoning — Free curriculum built on lateral-reading research; students evaluate live websites and social media posts, with lessons progressing from single-source checks to full corroboration tasks.
SIFT method (Mike Caulfield) — A four-move strategy (Stop; Investigate the source; Find better coverage; Trace claims to origin) designed as a fast, teachable alternative to checklist evaluation.
CRAAP Test (Meriam Library, CSU Chico) — Widely used currency/relevance/authority/accuracy/purpose checklist; useful as a starting scaffold but should be paired with lateral reading to avoid surface-cue errors.
Annotated bibliography assignments — Learners summarize, evaluate, and justify the role of each source in an emerging argument, making evaluative reasoning assessable. - Integrate ChatGPT into Quantum Theory (and similar STEM) courses as a supplement to traditional teaching, with students verifying chatbot answers collaboratively - Explicitly encourage readers to monitor how sources differing in trustworthiness, and reading order, influence their reliability perceptions - Combine conflicting-document discussion, declarative source knowledge, and contrasting-case practice to train source evaluation
Key Sources¶
- Wineburg, S., & McGrew, S. (2019). Lateral reading and the nature of expertise: Reading less and learning more when evaluating digital information. Teachers College Record, 121(11), 1–40. doi:10.1177/016146811912101102
- Braasch, J. L. G., Bråten, I., Strømsø, H. I., Anmarkrud, Ø., & Ferguson, L. E. (2013). Promoting secondary school students' evaluation of source features of multiple documents. Contemporary Educational Psychology, 38(3), 180–195. doi:10.1016/j.cedpsych.2013.03.003
- Britt, M. A., & Aglinskas, C. (2002). Improving students' ability to identify and use source information. Cognition and Instruction, 20(4), 485–522. doi:10.1207/S1532690XCI2004_2
- McGrew, S., Ortega, T., Breakstone, J., & Wineburg, S. (2017). The challenge that's bigger than fake news: Civic reasoning in a social media environment. American Educator, 41(3), 4–9.
Page metadata
| Field | Value |
|---|---|
type |
element |
id |
resource-evaluation |
title |
Resource Evaluation |
description |
Learners assess the credibility and relevance of sources. |
status |
review |
canonical |
True |
generated |
by claude/unspecified on 2026-08-29 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.