> hand out free top end model coding access for a bit and you'll very rapidly have developer data

They tried this - grok was free on openrouter for a while

Marketing push was there too, everyone was saying Grok had jumped Claude and Codex, yet I never got that when using all 3.

Turns out that benchmaxxing doesn't help if it's not very good when people actually try it.

It's more useful to have access your full code base compared to having access to only your input and the output they generate.

But imagine if they handed out free access to Kimi or GLM-5. Actually, I still wouldn't use it, because I avoid APIs that say they hold on to data.

And presumably they got data from it...

and then released a model that didn't really leave a mark with code performance