Dynamically generated proof graphs let LOGAX recognize all correct student solutions and give hints on them¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Across one exam and two homework exercises, all correct student solutions are recognized via dynamically generated DAMs, including solutions not in the initially generated DAM. → Josje Lodder 2021

Evidence¶

Josje Lodder 2021¶

Josje Lodder, Bastiaan Heeren, Johan Jeuring, Wendy Neijenhuis. (2021). Generation and Use of Hints and Feedback in a Hilbert-Style Axiomatic Proof Tutor. International Journal of Artificial Intelligence in Education 31:99-133. https://doi.org/10.1007/s40593-020-00222-2

q2 · i? · design · r2

Evaluation of recognition on correct solutions to one exam exercise (19 solutions) and two homework exercises (17 and 15 solutions), summarized in Table 3 by preferred, non-preferred, and dynamically recognized solutions. The authors conclude dynamic DAMs recognize all solutions; e.g. exam solutions using Axiom b appear only in the dynamically obtained DAM.

"The conclusion of this evaluation is that with the use of dynamically generated DAMs, we can recognize all student solutions, and also give hints."

Discussion¶

Related Claims¶

• Students struggle with constructing axiomatic proofs substantially more than with semantic tableaux in the same logic course — related
• Student mistakes in axiomatic proofs fall into three categories and can largely be covered by buggy rules — related
• Hints generated by LOGAX help students complete the exercises — related
• Proofs generated by LOGAX are comparable to expert proofs — related
• Hint Factory MDP-generated hints gave correct next-step hints over 80% of the time and a pilot showed students solved more logic proofs with hints — related