Students who formulated their own rules for when to use AI performed better on assignments in both conditions¶

Claim · All claims
Evidence · 1 study · causal r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Students in either condition who had set themselves rules for AI use (e.g., building a solution first, delegating syntax only) scored better on assignments. → Azimi 2026

Evidence¶

Azimi 2026¶

Azimi, S. (2026). AI Literacy over Tool Design: A Mixed-Methods Study of Scaffolded versus Unrestricted Generative AI in Programming Education. Delft University of Technology. https://arxiv.org/abs/2609.16784 doi:10.48550/arxiv.2609.16784

q2 · i? · causal · r2

Interview and reflection data from the pilot identified students in both conditions who had formulated rules such as "building a solution first and using AI only to check it"; these students "performed better on the assignments regardless of the condition". No effect size is printed.

"These students performed better on the assignments regardless of the condition to which they had been assigned."

Discussion¶

Related Claims¶

• Delegating the terminal evaluation to AI is self-defeating: each hand-off returns one more output someone must accept or not — related
• A scaffolded AI Study Coach produced no assignment-performance or concept-inventory advantage over unrestricted AI use in a master's programming course pilot — related
• The Coach's hint budget was managed poorly: students split into early-spenders and savers, and within the Coach condition only those with a deliberate hint strategy scored higher — related
• Reflective Practice Improves Outcomes When Structured — a broader claim this one bears on
• Problem-solving-prepared students often accepted the AI solution uncritically or critiqued it based on their own misconceptions — related