Professional developers write prompts of moderate baseline quality, which does not meaningfully scale with programming experience¶

Claim · All claims
Evidence · 1 study · causal r1 · q2 · i0 negligible
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2031: baselines and conditions change

Subclaims¶

q2 i0 Baseline prompt-quality averaged 63.04, with a near-zero Pearson correlation between years of experience and baseline score (r = 0.11), suggesting prompt-writing is a distinct skill. → Rohit Mehra 2026

Evidence¶

Rohit Mehra 2026¶

Rohit Mehra, Kapil Singi, Vikrant Kaulgud, Vibhu Saujanya Sharma, Swapnajeet Gon Choudhury, Swati Sharma, Adam P. Burden, Majd Sakr. (2026). Prompt Coach: An Empirical Evaluation of an Agentic Tutor for Learning Prompt Engineering in Software Development. https://arxiv.org/abs/2607.06074 doi:10.48550/arxiv.2607.06074

q2 · i0 · causal · r1

Baselining phase of the study: 15 developers wrote prompts for three APPS tasks across complexity levels, yielding a mean score of 63.04, which the article describes as "prompts of moderate quality". The correlation r = 0.11 is a printed effect size.

"A Pearson correlation (𝑟= 0.11) between years of experience and baseline score indicates that prompt-writing proficiency does not meaningfully scale with programming experience, suggesting it is a distinct skill and an emerging area of expertise."

Discussion¶

Related Claims¶

• A 60-minute session with Prompt Coach significantly improved professional developers' prompt quality, a 13.73% relative gain overall — related
• Learning-process and psychological constructs correlate only weakly with aggregate final artistic performance — related
• Token consumption is uncorrelated with task quality across models (r = −0.03), suggesting agents lack mechanisms for knowing when to stop — related