High school novices show large CT learning gains after using RoboBlockly Studio, improving Bebras performance from 1.28 to 2.88 of 4 tasks¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i3 large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i3 Participants' Bebras CT scores improved significantly from pre-test to post-test with a large within-subject effect size (dz = 1.69). → Leyi Li 2026

Evidence¶

Leyi Li 2026¶

Leyi Li, Chenyu Du, Jiafei Sun, Erick Purwanto, and Qing Zhang. (2026). RoboBlockly Studio: Conversational Block Programming with Embodied Robot Feedback for Computational Thinking. Designing Interactive Systems Conference (DIS '26). https://doi.org/10.1145/3800645.3813071

q3 · i3 · causal · r2

In the counterbalanced within-subject study (N=32 high school students, no prior programming experience), a 15-minute four-problem Bebras pre-test and matched post-test showed a significant gain: "1.28 out of 4 tasks correctly in the pre-test" versus 2.88 in the post-test, t(31)=9.53, p<.001, dz = 1.69; Wilcoxon confirmed (W = 430, p < .001).

"On average, participants solved 1.28 out of 4 tasks correctly in the pre-test (SD = 1.02), compared to 2.88 in the post-test (SD = 0.83). A paired-sample t-test confirmed that this difference was statistically significant, 𝑡( 31)= 9.53, 𝑝<. 001, with a large within-subject effect size (𝑑𝑧 = 1.69)."

Discussion¶

Related Claims¶

• Students with moderate initial CT levels show substantially greater self-efficacy gains than high-CT and low-CT peers, an 'Optimal Development Zone' effect — related
• Students show large immediate pre-to-post knowledge gains within a single LLM-supported learning session — related
• Latent profile analysis of pre-service teachers' CT skills identifies three profiles (Novice, Developing, Proficient), revealing heterogeneous, non-linear skill acquisition — related
• Five-day no-code AI agent creation improves students' CT self-perception, with large gains in abstract and algorithmic thinking and a medium gain in pattern recognition and generalization — related
• Novice secondary students show large pretest-to-posttest gains in learning and near transfer of probability calculation after studying a video modeling example, regardless of model or observer gender — related