No aptitude-treatment interaction: prior proficiency did not interact with hint type¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? No interactions were found between pretest proficiency and performance or hint metrics for the training or posttest, rejecting the hypothesized ATI effect. → Christa Cody 2021

Evidence¶

Christa Cody 2021¶

Christa Cody, Mehak Maniktala, Nicholas Lytle, Min Chi, Tiffany Barnes. (2021). The Impact of Looking Further Ahead: A Comparison of Two Data-driven Unsolicited Hint Types on Performance in an Intelligent Data-driven Logic Tutor. https://arxiv.org/abs/2102.05741

q3 · i? · causal · r2

The study hypothesized an aptitude-treatment interaction with higher-proficiency students benefiting from Waypoints and lower-proficiency students from Next-Step hints, but found no significant interactions for either training or posttest. "This means that H2 was rejected; Waypoint hints did not improve performance for higher proficiency students."

"No interactions were found between pretest proficiency and performance or hint metrics for the posttest."

Discussion¶

Learner Variables¶

• General Cognitive Ability — moderator: an instructional effect differs with it

Related Claims¶

• Next-Step hints outperform Waypoint hints on posttest total steps and accuracy — related
• Next-Step hints outperform Waypoint hints during training on time, steps, accuracy, and score — related
• Aptitude-treatment interaction: Assertions led low prior proficiency students to form significantly shorter posttest proofs than Messages — reports the opposite
• The effect of Tekster does not depend on students' initial writing proficiency — related
• Hypothesized ATI effects of individualized explanations based on typical mistakes were not supported; exploratory benefits emerged for high-resource vocational-school students — related
• Assertions significantly increase unsolicited hint usage (justification and needed rates) over Messages for students regardless of prior proficiency — related
• Aptitude-by-treatment interactions for instructional structure show mixed support: crossovers in some studies, nulls in others — related
• ATI research using static aptitude measures has yielded remarkably sparse robust results — a broader claim this one bears on
• Waypoint-High group struggled during training but no posttest differences between high-proficiency groups — related
• The Aptitude Treatment Interaction model has a significant effect on students' mathematical creative thinking abilities compared to the Problem Based Learning model — related