*slower with Sonnet 3.7 on large open source code bases where the developer is a senior member of the project core team.

https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...

I believe we'll see the benefits and drawbacks of AI augmentation to humans performing various tasks will vary wildly based on the task, the way the AI is being asked to interact, and the AI model.