Skip to content

Operationalization and description of instructional treatments in effect-of-instruction research

Research Method · All research methods
Evidence · 2 claims (2 for) · 2 studies (1 causal, 1 theoretical), q1–q3 · 0 of 2 report an effect size · 2 claims rest on one study

Description

The article argues that effect-of-instruction studies fail when instruction is merely given a methods label. It observes that "existing 'methods' of instruction were merely cited, and never described", so the actual implementation of materials was never documented. The study therefore specified approach, method, and procedure, developed materials from SLA theory, and reported the instructional component in detail so the instruction-effect link could be examined directly.

Accounts

  • Operationalize and describe the instructional treatment in effect-of-instruction research: The article argues that effect-of-instruction studies fail when instruction is merely given a methods label. It observes that "existing 'methods' of instruction were merely cited, and never described", so the actual implementation of materials was never documented. The study therefore specified approach, method, and procedure, developed materials from SLA theory, and reported the instructional component in detail so the instruction-effect link could be examined directly. (Catherine Doughty (1991))
  • Specify the geometry, shading, and rendering design choices of learning materials to create reproducible realism comparisons: The article recommends that research papers provide standardized information about learning materials so that a particular level of realism can be recreated with the same or other learning contents. A well-defined degree of realism is achieved when 'researchers and practitioners have enough information concerning the learning materials available to recreate that particular level of realism'. Authors should report software packages, plug-ins, unusual settings, and design choices such as whether the same 3D model underlies realistic and schematic versions and whether texture maps were used. (Skulmowski et al. (2022))

Claims

-

Key Sources

  • Catherine Doughty. (1991). Second Language Instruction Does Make a Difference: Evidence from an Empirical Study of SL Relativization. SSLA, 13, 431-469. https://doi.org/10.1017/S0272263100010287
  • Skulmowski, A., Nebel, S., Remmele, M., & Rey, G. D. (2022). Is a Preference for Realism Really Naive After All? A Cognitive Model of Learning with Realistic Visualizations. Educational Psychology Review. https://doi.org/10.1007/s10648-021-09638-1
Page metadata
Field Value
type research-method
id operationalization-and-description-of-instructional-treatments-in-effect-of-instruction-re
title Operationalization and description of instructional treatments in effect-of-instruction research
description The article argues that effect-of-instruction studies fail when instruction is merely given a methods label.
status review
generated by process:settle-candidates on 2026-10-17
trust unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.