Pennsylvania Teacher and Principal Evaluation Pilot (2010-2015), Phase 2 classroom-observation study¶

Element · All elements
Evidence · 3 claims (3 for) · 3 studies (3 associational), q2 · 0 of 3 report an effect size · 2 claims rest on one study

Description¶

A three-year pilot conducted by the Pennsylvania Department of Education, running from 2010 to 2015, in which principals evaluated teachers' classroom practice using The Framework for Teaching. Phase 2 of the pilot is the subject of this report, which assessed the internal consistency of observation scores, score variation, and relationships with value added. It was prepared for Team Pennsylvania Foundation and the Gates Foundation.

Design Implications¶

Context¶

Requirements¶

• State education agency sponsorship and principal participation in classroom observations

Constraints¶

• Findings are from Phase 2 of a pilot in one state's context

Target Learners¶

• K-12 teachers in Pennsylvania public schools

Target Learning Goals¶

• Evaluating and improving teaching practice through structured observation

Claims¶

• Teachers with higher Framework for Teaching scores tended to make larger contributions to student achievement (value added) [+W]
• Principals in the pilot did not typically use all 22 rubric components when observing teachers [+W]
• FFT-based teacher ratings in Pennsylvania's pilot were overwhelmingly concentrated in the top two performance categories, with less than 0.1 percent rated failing [+W]

Related Elements¶

• The Framework for Teaching observation rubric with 22 components in four domains
• Pennsylvania Teacher and Principal Evaluation Pilot (2010-2015)
• Value-added models (VAMs) developed and estimated for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot

Examples¶

-

Key Sources¶

• Elias Walsh, Stephen Lipscomb. (2013). Classroom Observations from Phase 2 of the Pennsylvania Teacher Evaluation Pilot: Assessing Internal Consistency, Score Variation, and Relationships with Value Added. Cambridge, MA: Mathematica Policy Research. https://www.mathematica.org/publications/classroom-observations-from-phase-2-of-the-pennsylvania-teacher-evaluation-pilot-assessing-internal-consistency-score-variation-and-relationships-with-value-added