Assess fidelity separately for instructional components and include student application when evaluating strategy instruction¶

Strategy · All strategies
Evidence · 2 claims (1 for, 1 mixed) · 1 study (1 associational), q3 · 0 of 1 report an effect size · 2 claims rest on one study

Description¶

The article recommends redesigning fidelity measurement so that quantitative predictors capture instructional quality. Future research should "provide separate fidelity scores for the different components of instruction (i.e. how, why, model, encourage, etc.)" and add "a separate section for student application of the processes", enabling examination of specific instruction components in relation to student application and a re-run of the regression against comprehension post-test scores.

Design Implications¶

Context¶

Requirements¶

• Fidelity instruments that currently combine modeling, how- and why-instruction into one score would need component-level coding
• Student application data would need to be collected alongside fidelity ratings

Constraints¶

• The current study's fidelity variable did not examine engaged reader process instruction in detail and did not include student application or teacher-student interactions

Target Learners¶

• third- and fourth-grade struggling readers in supplemental intervention

Target Learning Goals¶

• reading comprehension strategy instruction quality measurement

Claims¶

• Fidelity of implementation and percentage of instructional time on engaged reader processes added only 2% explained variance to comprehension post-test scores beyond controls [+W]
• Homogeneous comprehension-needs groups spent less time on engaged reader processes but received better-aligned instruction than heterogeneous groups [~W]

Related Strategies¶

• Assess whether and how the planned intervention is implemented
• Evaluate AI-use interventions for the specific process they target, from verification quality to reliance decisions and persistent learning

Examples¶

-

Key Sources¶

• Fatima Zehra Allahverdi, Lynn Gelzheiser. (2025). Comparison of more effective and typical teachers' instructional quality and implementation of engaged reader processes. Instructional Science. https://doi.org/10.1007/s11251-025-09725-8