Before a full-scale trial, define the intervention tightly and use paper-based outcome tests¶

Design · All designs
Evidence · 1 claim (1 for) · 1 study (1 qualitative), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description¶

The report draws two design lessons from this feasibility pilot. First, an under-specified intervention whose "distinctive features of feedback in sport were insufficiently defined" led to inconsistent implementation, so programmes should be clearly defined and less open to teacher interpretation before efficacy testing. Second, digital testing caused server glitches and school dropouts, so the report recommends that "paper-based tests are used" in any full trial. Both lessons come from the pilot's own process and outcome data.

Design Implications¶

Context¶

Requirements¶

A clearly specified programme with defined underpinning concepts and a manual or resource pack for teachers

Constraints¶

The recommendation about paper-based tests arises from technical difficulties specific to the digital Access Maths Test in this pilot, including a software glitch limiting test time to 30 minutes instead of 45

Target Learners¶

Year 9 secondary school pupils

Learning Goals¶

reliable measurement of attainment outcomes in evaluation trials

Claims¶

Plc Varied Implementation Not Ready For Full Trial [+M]

Examples¶

-

Key Sources¶

Cinzia Rienzo, Heather Rolfe and David Wilkinson. (2016). Powerful Learning Conversations: Evaluation report and executive summary. Education Endowment Foundation. https://www.educationendowmentfoundation.org.uk

Page metadata

Field	Value
`type`	`design`
`id`	`define-intervention-and-paper-tests-before-full-trial`
`title`	`Before a full-scale trial, define the intervention tightly and use paper-based outcome tests`
`description`	`The report draws two design lessons from this feasibility pilot.`
`status`	`review`
`generated`	by `process:settle-candidates` on `2026-11-01`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `cinzia-rienzo-2016`

Frontmatter is the page's machine-readable record — see the Schema & Guide.