Fairness of overall observation scores may not be substantially compromised by principals using different sets of rubric components¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2016: tool and model accuracy changes quickly

Subclaims¶

q2 i? The report's findings suggest the fairness of overall scores might not be compromised substantially when principals use different sets of the 22 components. → Elias Walsh 2013

Evidence¶

Elias Walsh 2013¶

Elias Walsh, Stephen Lipscomb. (2013). Classroom Observations from Phase 2 of the Pennsylvania Teacher Evaluation Pilot: Assessing Internal Consistency, Score Variation, and Relationships with Value Added. Cambridge, MA: Mathematica Policy Research. https://www.mathematica.org/publications/classroom-observations-from-phase-2-of-the-pennsylvania-teacher-evaluation-pilot-assessing-internal-consistency-score-variation-and-relationships-with-value-added

q2 · i? · associational · r?

Summary of the Phase 2 internal-consistency and score-variation analysis: although principals did not typically use all 22 components, the report suggests fairness of overall scores might not be substantially compromised by differing component sets. Hedged, no effect size printed.

"Although principals did not typically use all 22 components, the report's findings suggest the fairness of overall scores might not be compromised substantially by principals using different sets of components"

Discussion¶

Related Claims¶

• Principals in the pilot did not typically use all 22 rubric components when observing teachers — related
• Variation across schools in principal-assigned professional practice ratings suggests principals' standards may not be fully consistent across schools — related