Prompt Coach's largest learning gains occurred on Inclusion of Constraints, Error Handling, and Context Awareness, the dimensions developers scored lowest on at baseline¶

Claim · All claims
Evidence · 1 study · causal r1 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The largest post-learning gains were in Inclusion of Constraints, Error Handling, and Context Awareness, which were also the lowest-scoring baseline dimensions. → Rohit Mehra 2026

Evidence¶

Rohit Mehra 2026¶

Rohit Mehra, Kapil Singi, Vikrant Kaulgud, Vibhu Saujanya Sharma, Swapnajeet Gon Choudhury, Swati Sharma, Adam P. Burden, Majd Sakr. (2026). Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development. https://arxiv.org/abs/2607.06074 doi:10.48550/arxiv.2607.06074

q2 · i? · causal · r1

Dimension-wise results of the 15-developer pre/post study (Table 2): Inclusion of Constraints +31.63% (50.51 to 66.49), Error Handling +30.66%, Context Awareness +23.61%, each statistically significant per the article. The authors call these "developers' cognitive blind spots".

"the largest gains were observed in Inclusion of Constraints, Error Handling, and Context Awareness, which were also the lowest-scoring di- mensions at baseline, suggesting that PC is particularly effective at addressing developers' cognitive blind spots."

Discussion¶

Related Claims¶

• A 60-minute session with Prompt Coach significantly improved professional developers' prompt quality, a 13.73% relative gain overall — related
• Learning gains were highest for students whose background knowledge was lowest at pre-test — a broader claim this one bears on
• Middle school students with the lowest baseline argumentative-writing scores showed the largest growth across essay attempts on an AES platform, while mid- and high-baseline students showed limited or no significant change — a broader claim this one bears on