Scorers found all rubric dimensions important, with feedback bearing mainly on the scoring and training process rather than rubric design¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2021 · checked against its sources 2026-10-09 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Focus groups and survey results indicated scorers found all rubric dimensions to be important, and scorer feedback had more implications for the scoring/training process than for rubric design. → Iwatani 2021
Evidence¶
Iwatani 2021¶
Iwatani, E., Means, B., Seylar, J., and Hardy, A. (2021). Rubrics on historical thinking skills for assignments and student work: Initial validity evidence. Digital Promise. https://doi.org/10.51388/20.500.12265/112
q2 · i? · design · r2
Scorer feedback collected during the July 2020 Rubric Pilot Session, in which three expert teachers provided oral and written feedback on rubric usability alongside their scores. As the article reports, "VcRUeUV fRXnd all UXbUic dimenViRnV WR be imSRUWanW", supporting the claim that the rubrics measure valuable historical thinking skills.
"FRcXV gURXSV and VXUYe\ UeVXlWV indicaWed WhaW VcRUeUV fRXnd all UXbUic dimenViRnV WR be imSRUWanW. The VcRUeU feedback had mRUe imSlicaWiRnV fRU Whe VcRUing/WUaining SURceVV Whan fRU Whe UXbUic deVign (ASSendi[ G)."
Discussion¶
Related Claims¶
- Two rubric dimensions (claims and evidence, comparison) showed low inter-scorer consistency in the pilot — related
- Scorers had difficulty distinguishing rubric scoring from everyday grading and AP scoring, and training took longer than expected — related
- Trained scorers applied the historical thinking skills rubrics with good overall inter-rater consistency — related
- Scorer severity and standard difficulty were statistically adjusted using Many-Facet Rasch analysis before assignment and work measures were compared — related
- World History Project assignments scored higher on most learning opportunity rubric dimensions than other assignments — related
- Rubric scoring supports answering diagnostic questions about opportunities for and evidence of historical thinking — related
- World History Project adoption increases learning opportunities for historical thinking in summative activities relative to business-as-usual curricula — related
- The historical thinking rubrics were developed with construct and validity evidence from the literature and teacher/reviewer review — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
scorer-feedback-dimensions-important-process-implications |
title |
Scorers found all rubric dimensions important, with feedback bearing mainly on the scoring and training process rather than rubric design |
description |
Scorers found all rubric dimensions important, with feedback bearing mainly on the scoring and training process rather than rubric design |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2021 |
source_checked |
2026-10-09 |
generated |
by process:wiki-ingest on 2026-10-09 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — iwatani-2021 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.