Does that productivity increase translate into monetary gains for the company that are greater than the token+compute+other new inteoduced expenses? For smaller companies I can believe it, but massive orgs like Cisco I’m really not so sure. You can be extremely productive and not actually contribute to the company cash flow
I think you make a point that is worthy of discussion, but the first sentence is unnecessarily hostile. The comment you responded to already made a caveat that they might be too cynical.
Maybe this is the reason why I will never be a C-suite person. But if my product/service workforce became 20% more productive I would direct my sales department that we have more capacity to overtake our competitors and/or deliver more from the backlog of requests from existing customers which we can invoice for. And at the end of the year celebrate a double-digit growth.
The "evidence" that you think about is probably that dopamine hit you felt when the shit-generator spat out a complete half-finished react app. But that's not evidence of increased productivity, unless we now measure productivity by the size of the codebase bloat.
No it doesn't - that data is self-reported, and the 2025 study explicitly compares _against_ self-reported data.
Granted, I agree models have improved since then, but still.
> Importantly, survey results are not necessarily grounded in reality. There are reasons to be skeptical of people’s responses to counterfactual questions such as about AI’s effect on productivity — for instance, our study in early 2025 found that people overestimated AI’s effect on their time spent on tasks by 40 percentage points on average.
Not really? I mean, the original study says this, in essence:
1. Developers _self_ report a 1.5-2x increase in productivity
2. Empirical measurements show 20% slowdown
Now, that study is from 2025, so it may be outdated.
The study you linked and claim contradicts the 20% slowdown is only _self reported_ data, which the original study proves is unreliable and overestimates productivity.
In fact, the study _you linked_ says this:
> In 2 of these 7 cases we were able to view public outputs from the work completed using AI. We are confident that in both cases the participants are overstating their change in value produced as we understand it; at least, the enormously more valuable work is not externally visible.
> In 2 other cases, we are somewhat suspicious of large changes in the value of work produced because qualitative claims do not match our intuitive sense of agent capabilities.
> There is 1 instance where our best sense is that the respondent does indeed have agents doing an impressive quantity of productive work, although we suspect that this work is better captured by improved speed or quantity of output, not improved value of output.
> In the remaining 2 cases we lack sufficient qualitative information to meaningfully interpret.
Can you link to any actual evidence about this 10-20% productivity increase? And I don't mean anecdata like "I'm totally like 8200% more productive!1" that the AI bros love to spew.
From what I'm seeing at the Co I work for with ~1300 devs, productivity is more or less the same as it has always been. Projects aren't being done noticeably faster, there's no less bugs than before (if anything things are more unstable), the backlog remains endless. And we do all the crap that the AI hype tells us to do, we've got harnesses, complex agentic setups etc.
Does that productivity increase translate into monetary gains for the company that are greater than the token+compute+other new inteoduced expenses? For smaller companies I can believe it, but massive orgs like Cisco I’m really not so sure. You can be extremely productive and not actually contribute to the company cash flow
I think you make a point that is worthy of discussion, but the first sentence is unnecessarily hostile. The comment you responded to already made a caveat that they might be too cynical.
Fair
Maybe this is the reason why I will never be a C-suite person. But if my product/service workforce became 20% more productive I would direct my sales department that we have more capacity to overtake our competitors and/or deliver more from the backlog of requests from existing customers which we can invoice for. And at the end of the year celebrate a double-digit growth.
Lol, so much "productivity" bullshit from the LLM-crowd but hardly any new innovations or products. Something is off here.
> all evidence points to AI bringing at least 10-20% more productivity.
No, actually all evidence points exactly to a ~20% slowdown> https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
The "evidence" that you think about is probably that dopamine hit you felt when the shit-generator spat out a complete half-finished react app. But that's not evidence of increased productivity, unless we now measure productivity by the size of the codebase bloat.
Newer evidence from same group invalidates the outdated claim https://metr.org/blog/2026-05-11-ai-usage-survey/
No it doesn't - that data is self-reported, and the 2025 study explicitly compares _against_ self-reported data.
Granted, I agree models have improved since then, but still.
> Importantly, survey results are not necessarily grounded in reality. There are reasons to be skeptical of people’s responses to counterfactual questions such as about AI’s effect on productivity — for instance, our study in early 2025 found that people overestimated AI’s effect on their time spent on tasks by 40 percentage points on average.
- your linked study
> No, actually all evidence points exactly to a ~20% slowdown>
It contradicts this
Not really? I mean, the original study says this, in essence:
1. Developers _self_ report a 1.5-2x increase in productivity 2. Empirical measurements show 20% slowdown
Now, that study is from 2025, so it may be outdated.
The study you linked and claim contradicts the 20% slowdown is only _self reported_ data, which the original study proves is unreliable and overestimates productivity.
In fact, the study _you linked_ says this:
> In 2 of these 7 cases we were able to view public outputs from the work completed using AI. We are confident that in both cases the participants are overstating their change in value produced as we understand it; at least, the enormously more valuable work is not externally visible.
> In 2 other cases, we are somewhat suspicious of large changes in the value of work produced because qualitative claims do not match our intuitive sense of agent capabilities.
> There is 1 instance where our best sense is that the respondent does indeed have agents doing an impressive quantity of productive work, although we suspect that this work is better captured by improved speed or quantity of output, not improved value of output.
> In the remaining 2 cases we lack sufficient qualitative information to meaningfully interpret.
(edits for formatting)
ALL evidence?
I have seen data going both ways.
But if you are the company delivering those productivity gains, why would you layoff and thus lose an opportunity to grow?
Can you link to any actual evidence about this 10-20% productivity increase? And I don't mean anecdata like "I'm totally like 8200% more productive!1" that the AI bros love to spew.
From what I'm seeing at the Co I work for with ~1300 devs, productivity is more or less the same as it has always been. Projects aren't being done noticeably faster, there's no less bugs than before (if anything things are more unstable), the backlog remains endless. And we do all the crap that the AI hype tells us to do, we've got harnesses, complex agentic setups etc.
All the recent academic studies disagree with you.