At UofT, GATs produced a reliable end-of-course increase in Constructive engagement, with no effects on Passive, Active engagement, or MSLQ elaboration¶

Claim · All claims
Evidence · 1 study · causal r2 · q3
Currency · no dated study recorded · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q3 i? GATs produced a reliable increase in Constructive engagement at the end of the course at UofT, while other engagement instruments showed no effects surviving correction. → constructive-engagement

Evidence¶

constructive-engagement¶

Yuri Noviello, Naaz Sibia, Anastasiia Birillo, Thomas Overklift Vaupel Klein, Michael Liut, and Gosia Migut. 2026. AI-Generated Traces for Novice Programmers: Learning Effects and Learner Differences in a Multi-Institutional Study. Proceedings of the 31st ACM Conference on Innovation and Technology in Computer Science Education V. 1 (ITiCSE 2026). https://doi.org/10.1145/3803400.3809346

q3 · i? · causal · r2

Post-survey analysis at UofT (N=398) using CAP engagement instruments and MSLQ elaboration; Table 1 row 30 reports Constructive engagement Δ=0.212, p=0.016, padj=0.049. The article states constructive engagement reflects sense-making behaviors such as generating inferences and connecting representations.

"In the larger study at UofT,GATsproduced a reliable increase inCon- structive engagementat the end of course, while Passive and Active engagement and MSLQ elaboration showed no effect."

Discussion¶

Learner Variables¶

Motivation — outcome: instruction changes it
Interest — outcome: instruction changes it

Scaffolded assistant support marks richer constructive participation at the conversation level across all six task settings — the general claim this finding bears on, with the studies behind it
Engagement profiles significantly moderated GATs' immediate performance effects: low- and high-engagement profiles benefited while the mid-engagement profile showed a small decrement — related
Generative (Constructive) engagement by young children produces better learning than attentive (Passive) engagement — related
GATs produced no reliable immediate learning-experience effects on frustration, cognitive load, or situational interest at either institution — related
In the Python-based CS1 course at UofT, GATs produced no significant overall or topic-specific immediate performance effects — related
Across both institutions, GATs showed no significant effect on long-term summative exam performance — related
In the Java-based CS1 course at TU Delft, GATs significantly improved immediate post-intervention performance pooled across topics, driven mainly by the While-loop intervention — related
Constructive learning beats active and passive learning — a broader claim this one bears on

Page metadata

Field	Value
`type`	`claim`
`id`	`gats-increase-constructive-engagement-uoft`
`title`	`At UofT, GATs produced a reliable end-of-course increase in Constructive engagement, with no effects on Passive, Active engagement, or MSLQ elaboration`
`description`	`At UofT, GATs produced a reliable end-of-course increase in Constructive engagement, with no effects on Passive, Active engagement, or MSLQ elaboration`
`status`	`review`
`evidence_strength`	`moderate`
`source_checked`	`2026-10-20`
`generated`	by `process:wiki-ingest` on `2026-10-10`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `constructive-engagement`

Frontmatter is the page's machine-readable record — see the Schema & Guide.