FFT scores showed acceptable-to-good internal consistency, with the overall PPR score more internally consistent than any single domain score¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2018: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? FFT domains and their components appeared to measure similar concepts, and the overall PPR score had higher internal consistency than any of the domain scores in both pilot phases. → Stephen Lipscomb 2015
Evidence¶
Stephen Lipscomb 2015¶
Stephen Lipscomb, Jeffrey Terziev, Duncan Chaplin. (2015). Measuring Teachers' Effectiveness: A Report from Phase 3 of Pennsylvania's Pilot of the Framework for Teaching. Washington, DC: Mathematica Policy Research. https://www.mathematica.org/publications/measuring-teachers-effectiveness-a-report-from-phase-3-of-pennsylvanias-pilot-of-the-framework
q2 · i? · associational · r2
Psychometric analysis of FFT scores across both pilot phases (2011-2012 and 2012-2013). The report found internal consistency "in the acceptable to good ranges in both phases", with the overall PPR score exceeding every domain score.
"The levels of internal consistency were in the acceptable to good ranges in both phases, with the overall PPR score having higher consistency than any of the domain scores in both phases."
Discussion¶
Related Claims¶
- FFT-based teacher ratings in Pennsylvania's pilot were overwhelmingly concentrated in the top two performance categories, with less than 0.1 percent rated failing — related
- FFT scores correlated positively with value-added measures, with domain correlations ranging from 0.19 to 0.22 and generally statistically significant — related
- Rating distributions and FFT-VAM relationships were broadly similar across the two pilot phases, though top-two-category ratings decreased somewhat in Pittsburgh — related
- The 16-item CT–PCK Survey shows internal consistency reliability around .71–.72 and person separation reliability of .69 — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
fft-internal-consistency-acceptable-to-good |
title |
FFT scores showed acceptable-to-good internal consistency, with the overall PPR score more internally consistent than any single domain score |
description |
FFT scores showed acceptable-to-good internal consistency, with the overall PPR score more internally consistent than any single domain score |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2015 |
recheck_by |
2018 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — stephen-lipscomb-2015 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.