Waypoint hints show lower justification and adoption rates than Next-Step hints¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? The Next-Step group justified a significantly higher percentage of hints, and Waypoint hints had a significantly lower Adoption Rate. → Christa Cody 2021

Evidence¶

Christa Cody 2021¶

Christa Cody, Mehak Maniktala, Nicholas Lytle, Min Chi, Tiffany Barnes. (2021). The Impact of Looking Further Ahead: A Comparison of Two Data-driven Unsolicited Hint Types on Performance in an Intelligent Data-driven Logic Tutor. https://arxiv.org/abs/2102.05741

q3 · i? · causal · r2

Hint metrics during training for 114 students showed Next-Step hints justified at 89%(7) versus Waypoints at 84%(12), and adopted at 83%(10) versus 74%(17). This provides evidence supporting H3 that Waypoint hints are harder to derive.

"The Next-Step group justified a significantly ( F (2, 111) = 12 .96, p < 0.01) higher percentage of hints, as shown by the Justification Rate. Additionally, of the justified hints, we also saw a significantly ( F (2, 111) = 5 .49, p = 0 .01) lower Adoption Rate of the WP hints in students’ final proofs"

Discussion¶

Related Claims¶

• Next-Step hints outperform Waypoint hints on posttest total steps and accuracy — related
• Next-Step hints outperform Waypoint hints during training on time, steps, accuracy, and score — related
• Assertions significantly increase unsolicited hint usage (justification and needed rates) over Messages for students regardless of prior proficiency — related