> Or tell you how to use the tools you already have, but sure whatever.

But that's missing the point of the writing tools example: The models can unilaterally do this, and if prompted properly they will do this today. Writing an agent loop that will encourage the agent to build up it's own library of tools and prefer that library first, using a small (possibly local) model to select, is literally no more than a couple of hundred lines of code.

I wrote a toy coding agent a while back, and I started just with the ability for it to run shell commands. Every other tool the model wrote itself. At some point it even tried to restart itself to get access to the tool it had just written.

The providers only control a miniscule proportion of tooling, and the models themselves are capable enough that they will never control most of the tooling.

As a result, a lot of effort is going into optimising this to reduce token use.

But what we're seeing is that the main driver for this is not to spend less, but to do more, because we get enough value out of these models that every cost saving measure makes it possible to at a minimum spend the same to do more, but often even to spend more.

I'm doing projects now that would be financially unviable just 6 months ago.