Performance assessments can be reliably scored when designed appropriately and used with other measures¶

Claim · All claims
Evidence · 1 study · review r2 · q1
Currency · newest study 2025 · checked against its sources 2026-10-13 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q1 i? The report asserts that appropriately designed performance assessments used in conjunction with other measures can generate trustworthy and comparable scores at the student and aggregate levels. → Badrinarayan 2025

Evidence¶

Badrinarayan 2025¶

Badrinarayan, A. (2025). Instructionally relevant assessment systems: What is the role of performance assessments? Learning Policy Institute. https://doi.org/10.54300/411.469

q1 · i? · review · r2

This is the report's own summary assertion, supported by its description of scoring approaches in programs such as AP, IB, and NAEP that train raters, use multiple raters, and audit samples; the report presents no new empirical analysis of reliability.

"When they are designed appropriately and used in conjunction with other measures, performance assessments can be reliably scored, generating trustworthy and comparable scores at the student and aggregate levels."

Studies bearing on this claim¶

Can methods scored by judgement be scored reliably, or do they add rater variation? This table gathers the studies behind this claim and the 4 narrower claims that bear on it: 5 distinct studies (2 qualitative, 1 review, 1 associational, 1 design), q1–q3, 0 of 5 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.

Discussion¶

Related Claims¶

• Districts face validity, reliability, comparability, and accountability-tension challenges in assessing future-ready skills — related
• Test-taking engagement plays an essential role in the pursuit of valid scores — related
• The authors assert that innovative assessment measures capture POG competencies more fully than traditional standardized tests — related
• Reporting of reliability and validity evidence for quantitative motivation measures was incomplete in K‑5 writing‑motivation studies — related
• In one community-college lab class, six scorers rating six teams with an engineering rubric differed by a mean of 1.2 of 9 points, which the authors read as a sign the rubric may not be reliable — related
• Making trustworthiness metrics and visualizations explicit increased inter-rater reliability among learning engineers evaluating LLM responses — related