Data Driven Inquiry¶

Strategy · All strategies
Evidence · 1 claim (1 for) · 3 studies (2 quant-synthesis, 1 review), q2–q3 · 2 of 3 report an effect size

Description¶

Data driven inquiry is a structured, collaborative cycle in which educators examine evidence of student learning — assessment results, work samples, attendance, engagement data — to identify learning gaps, generate hypotheses about their causes, and design and test instructional responses. It is typically carried out in teams (data teams, professional learning communities) using a repeated protocol: collect data, analyze for patterns, infer causes, act, and re-examine. The strategy treats instructional decisions as hypotheses to be tested rather than assumptions to be defended.

Design Implications¶

Data driven inquiry operationalizes Assessment for Learning at the instructional-program level: evidence is used to adapt teaching rather than merely to certify outcomes Formative assessment practices improve achievement. [+S]. Its effectiveness depends on the quality of the inquiry, not the quantity of data — teams that move quickly from data to a pre-selected solution, or that read data without surfacing underlying assumptions about learners, show little instructional change [~M]. Structured protocols that slow the leap from observation to action are what distinguish genuine inquiry from data theater.

Context¶

Requirements¶

• Valid, timely data that actually maps to the learning goals being taught (not only summative accountability data)
• A facilitator and a disciplined protocol (e.g., data-driven dialogue, "notice/wonder" rounds) that separates observation from interpretation
• Protected collaborative time and psychological safety, since honest analysis of data implicates everyone's practice
• Authority and time to change instruction based on findings — inquiry without decision rights produces cynicism

Constraints¶

• Summative, delayed, or coarse-grained data (e.g., annual test scores) arrives too late and at too low a resolution to inform instruction [~M]
• Data conversations dominated by a single interpretation or by accountability pressure lead to defensive, surface-level analysis rather than changed practice [-M]
• Over-reliance on easily quantified measures narrows instruction toward what is measured [-M]
• Teams without facilitation tend to stop at describing the data ("the scores are low") without causal reasoning or action

Implementation Variability¶

• Data teams / PLC cycles (e.g., Solution Tree's PLC model): recurring grade-level or department teams analyzing common assessment results
• Instructional rounds: school-wide observation and evidence collection focused on a chosen problem of practice
• Classroom-level formative cycles: individual teachers using exit tickets, Check-Ins, and item analysis to adjust the next lesson
• Design-based research partnerships: researchers and practitioners co-analyzing data over extended cycles

Target Learners¶

• Indirect: all students, but the strongest documented gains occur when inquiry focuses on specific, item-level learning gaps rather than aggregate scores Formative assessment practices improve achievement. [+S]
• Struggling learners benefit most when inquiry leads to targeted reteaching and Coaching rather than generic whole-class repetition
• Teachers new to a curriculum or to interpreting assessment evidence gain the most from facilitated team inquiry

Target Learning Goals¶

• Instructional improvement goals: diagnosing and closing specific skill or concept gaps
• Teacher professional learning: building assessment literacy and causal reasoning about student learning
• Equity goals: surfacing patterns in which student groups are underserved by current instruction

Instructions¶

1. Frame a question of practice grounded in a learning goal, not a data source ("Why are students failing items on proportional reasoning?").
2. Collect and display relevant evidence — common Assessment results, anonymized student work, and classroom evidence at a grain size actionable within weeks.
3. Observe before interpreting — use a protocol that forces "noticings" to be separated from explanations, guarding against confirmation bias.
4. Generate multiple causal hypotheses, including ones about instruction rather than only about students; prioritize using Class Discussion norms that invite dissent.
5. Act on the leading hypothesis — design a targeted instructional response (reteaching, Coaching, revised tasks) and commit to a timeline.
6. Re-assess and iterate — collect new evidence on the same goal and repeat the cycle; treat the first response as a test, not a fix.

Related Strategies¶

• Action Research — the individual-teacher, research-oriented cousin of team data inquiry
• Formative Assessment — supplies the fine-grained, timely evidence that makes inquiry actionable
• Collaborative Inquiry — the broader team-learning pattern this strategy instantiates
• Data-driven decision-making practices in tutoring programs

Examples¶

• Data Wise (Harvard Graduate School of Education) — an eight-step protocol used by schools and districts to organize faculty data inquiry, emphasizing "creating a climate for data use" before analysis begins.
• PLC common assessment cycles (Solution Tree / AllThingsPLC, https://www.allthingsplc.info) — grade-level teams administer common formative assessments, analyze item-level results by student group, and plan tiered reteaching.
• Cognitively Guided Instruction — teachers analyze student strategy data on math problems to infer children's informal reasoning and adapt instruction accordingly.

Key Sources¶

• Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. doi:10.1080/0969595980050102
• Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71–85. doi:10.1080/00461520.2012.667064
• Datnow, A., & Hubbard, L. (2016). Teacher capacity for and beliefs about data-driven decision making: A literature review of international research. Journal of Educational Change, 17(1), 7–28. doi:10.1007/s10833-015-9264-2
• Earl, L. M., & Katz, S. (2006). Leading schools in a data-rich world: Harnessing data for school improvement. Corwin Press.
• Boudett, K. P., City, E. A., & Murnane, R. J. (Eds.). (2013). Data wise: A step-by-step guide to using assessment results to improve teaching and learning (Rev. ed.). Harvard Education Press.