Skip to content

Systematic screening for opportunistic experiments

Research Method · All research methods
Evidence · 1 claim (1 for) · 1 study (1 theoretical), q1 · 0 of 1 report an effect size · 1 claim rests on one study

Description

The guide recommends that researchers and policymakers "discuss issues to consider when identifying potential opportunistic experiments" before undertaking one, treating candidate screening as a deliberate step rather than an afterthought. Because opportunistic experiments piggyback on planned interventions or policy changes, the feasibility and validity of the resulting randomization depend on how well the opportunity is assessed up front.

Accounts

  • When identifying opportunistic experiments, systematically consider the issues the guide enumerates before committing: The guide recommends that researchers and policymakers "discuss issues to consider when identifying potential opportunistic experiments" before undertaking one, treating candidate screening as a deliberate step rather than an afterthought. Because opportunistic experiments piggyback on planned interventions or policy changes, the feasibility and validity of the resulting randomization depend on how well the opportunity is assessed up front. (Alexandra Resch et al. (2014))
  • A district guide for embedding RCTs into planned policies and programs: This guide, published by the U.S. Department of Education's Institute of Education Sciences, is written for "district and school leaders" and "shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs." It also "outlines the key steps to conduct RCTs and responds to common questions and concerns about RCTs." It is a practical reference document rather than an empirical study. (Lauren Akers et al. (2014))
  • Opportunistic experiments: RCTs of planned interventions or policy changes with minimal added disruption and cost: The guide names and defines opportunistic experiments as "type of randomized controlled trial that study the effects of a planned intervention or policy change with minimal added disruption and cost." The framework rests on exploiting naturally occurring planned changes—such as policy shifts or program rollouts—as sources of randomization, so rigorous causal evidence can be obtained without designing a new study from scratch. The guide defines the concept, provides examples, and organizes practice around identifying candidate opportunities and completing the experiments. (Alexandra Resch et al. (2014))

Claims

Key Sources

  • Alexandra Resch, Jillian Berk, Lauren Akers. (2014). Recognizing and Conducting Opportunistic Experiments in Education: A Guide for Policymakers and Researchers. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee/edprojects
  • Lauren Akers, Alexandra Resch, Jillian Berk. (2014). Making the Most of Opportunities to Learn What Works: A School District's Guide. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://www.mathematica.org/publications/making-the-most-of-opportunities-to-learn-what-works-a-school-districts-guide
Page metadata
Field Value
type research-method
id systematic-screening-for-opportunistic-experiments
title Systematic screening for opportunistic experiments
description The guide recommends that researchers and policymakers "discuss issues to consider when identifying potential opportunistic experiments" before undertaking one, treating candidate screening as a deliberate step rather than an afterthought.
status review
moved_from element/district-guide-opportunistic-rcts, theory/opportunistic-experiments-definition
generated by process:settle-candidates on 2026-10-09
trust unverified — no one has confirmed this page's content
sources 2 — lauren-akers-2014, alexandra-resch-2014

Frontmatter is the page's machine-readable record — see the Schema & Guide.