No significant condition differences remain at posttest: both approaches converge on MVC strategy and reasoning after both phases¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q3 · i3 large
Currency · newest study 2025 · checked against its sources 2026-10-20 (automated, 2 of 2 entries) · not reviewed by a person

Subclaims¶

q3 i? On Task 2, MANCOVA showed no significant differences between conditions on the four MVC-strategy components. → Saba 2025 q3 i3 MVC reasoning improved significantly from pretest to posttest for all students, with no significant difference between conditions at posttest. → Saba 2025 (2)

Evidence¶

Saba 2025¶

Saba, J., Kapur, M., & Roll, I. (2025). Learning about multivariable causality with interactive simulations: exploration before instruction may hurt immediate gains but benefits transfer. Instructional Science, 53, 1603–1632. https://doi.org/10.1007/s11251-025-09726-7

q3 · i? · causal · r2

MANCOVA on Task 2 posttest log files with virus-spread pretest as covariate found "no significant differences between conditions" on Time, Quantity, Quality and Efficiency (ηp2 = 0.042).

"As shown in Table 5, there were no significant differences between conditions: F(1,69) = 0.718, p = 0.582, ηp2 = 0.042 for the MVC strategy, and no significant effect of the covariate F(1,69) = 0.600, p = 0.664, ηp2 = 0.036."

Saba 2025 (2)¶

Saba, J., Kapur, M., & Roll, I. (2025). Learning about multivariable causality with interactive simulations: exploration before instruction may hurt immediate gains but benefits transfer. Instructional Science, 53, 1603–1632. https://doi.org/10.1007/s11251-025-09726-7

q3 · i3 · causal · r2

Repeated-measures ANOVA on virus-spread pretest versus Task 2 reasoning scores showed a significant main pre-post effect (ηp2 = 0.268); posttest means were Exploration-first M = 1.2 (SD = 1.44) versus Instruction-first M = 1.56 (SD = 1.43), with "no significant difference between conditions".

"students’ MVC reasoning improved from pretest to posttest, F(1,69)= 25.316, p<0.001, ηp2 = 0.268 with a large effect size. There was no significant difference between conditions on the posttest"

Discussion¶

Related Claims¶

• Exploration-first students show more advanced MVC reasoning on the transfer task than Instruction-first students — related
• Exploration-first students transfer MVC-strategy Efficiency better, with condition-by-Task-2 interactions for Efficiency and Quality — reports the opposite
• Instruction before exploration yields immediate MVC-strategy advantages in the first exploration task, driven by shorter exploration time — related
• Guidance during initial problem solving does not translate into better learning from subsequent instruction — related
• Post-baseline practice condition has a significant multivariate effect on combined posttest performance and observed practice effort after adaptive AI-assisted pretesting — related
• PS-I with a virus transmission simulation showed better transfer of multivariable causality to a new context, despite similar end-of-intervention performance to I-PS — related
• The two teacher groups did not differ on released-math tasks; both groups made pretest-to-posttest gains, suggesting math-in-science-context tasks better capture OpenSciEd math reasoning — related