The report concludes more validity evidence is needed before using FFL scores to identify effective and ineffective school leaders¶
Claim · All claims
Evidence · 1 study · associationalr2·q1
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2017: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q1 i? The authors conclude that the pilot findings do not yet establish the validity of FFL scores for identifying effective and ineffective school leaders. → Bing-ru Teh 2014
Evidence¶
Bing-ru Teh 2014¶
Bing-ru Teh, Hanley Chiang, Stephen Lipscomb, Brian Gill. (2014). Measuring School Leaders' Effectiveness: An Interim Report from a Multiyear Pilot of Pennsylvania's Framework for Leadership. REL Mid-Atlantic, Institute of Education Sciences. https://www.mathematica.org/publications/measuring-school-leaders-effectiveness-an-interim-report-from-a-multiyear-pilot-of-pennsylvanias
q1 · i? · associational · r2
The authors' interpretive conclusion drawn from the pilot's findings on internal consistency, score variation, and concurrent validity; it is an author judgment rather than a tested result.
"These findings suggest that more evidence is needed on the validity of using FFL scores to identify effective and ineffective school leaders."
Discussion¶
Related Claims¶
- A multiyear pilot study analyzed the score variation, internal consistency, score stability, and concurrent validity of Pennsylvania's Framework for Leadership — related
- FFL scores were not associated with school leaders' estimated contributions to student achievement growth — reports the opposite
- Principals with higher FFL scores make larger estimated contributions to student achievement growth (concurrent validity) — reports the opposite
- FFL has concurrent validity primarily among principals with three to six years of tenure as their school's leader — related
- School leaders' FFL scores are moderately stable year to year (correlation of .54) — related
- The FFL shows good internal consistency across its full scale and its four categories of leadership practices — related
- School leaders who scored higher in one category of FFL leadership practices tended to score higher in the other categories — related
- Most school leaders received scores in the top two performance categories on FFL-measured practices — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
more-evidence-needed-ffl-validity |
title |
The report concludes more validity evidence is needed before using FFL scores to identify effective and ineffective school leaders |
description |
The report concludes more validity evidence is needed before using FFL scores to identify effective and ineffective school leaders |
status |
review |
evidence_strength |
weak |
newest_evidence |
2014 |
recheck_by |
2017 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — bing-ru-teh-2014 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.