Cumulative meta-analysis shows reported GenAI productivity effects remained stable over time (stabilizing at g = 0.331) despite rapid advancement of underlying foundation models.¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The cumulative meta-analysis ordered by publication year shows a consistent, modest productivity gain that remains stable as studies are added, with the estimate stabilizing at g = 0.331. → Maier 2026

Evidence¶

Maier 2026¶

Maier, S., Gunzenhäuser, M., Schweisthal, J., Schneider, M., & Feuerriegel, S. (2026). A meta-analysis of the effect of generative AI on productivity and learning in programming. arXiv preprint. https://arxiv.org/abs/2605.04779 doi:10.48550/arxiv.2605.04779

q2 · i? · quant-synthesis · r3

Cumulative meta-analysis ordered by publication year (2022–2025), adding studies chronologically to update the pooled estimate. The article reports "the cumulative estimate stabilized at a small, consistent productivity gain (g= 0.331) as evidence accumulated" and notes this suggests raw model capability or AI literacy may not be the primary drivers of productivity gains.

"Rather, the cumulative estimate stabilized at a small, consistent productivity gain (g= 0.331) as evidence accumulated."

Discussion¶

Related Claims¶

• Cumulative rapid experimentation improved next-item correctness by 10% and cognitive engagement by 14% over five months — related
• Smaller local LLMs show a minor position bias toward option ordering and partially guessing-like error variation, but accuracy remains relatively stable across permutations and repeated sampling runs — related