The only thing faster moving that AI these days are the goalposts. Three years ago we would have been amazed if models were able to produce anything, now we have the luxury of nitpicking. Even the worst entries in the benchmark are quite impressive.
The only thing faster moving that AI these days are the goalposts. Three years ago we would have been amazed if models were able to produce anything, now we have the luxury of nitpicking. Even the worst entries in the benchmark are quite impressive.
Using reference images is a huge step for this sort of thing. The text-only approaches I've seen before were never going to be that good even with "perfect" AI, simply because describing 3D objects in text is not something that anyone is really any good at.
I remember getting wound up about latency and server issues playing counter-strike in the early '00s. At the same time though, it was hard to justify being angry because playing a multiplayer game with friends who were scattered all over town was something that had to be real magic.
I guess the wow!->adjust->complain->wow!->... cycle is endless as a human
No one asked for faster horses, they still became obsolete when cars came. Nothing new
> No one asked for faster horses
Err, yes they did. Thousands of years of husbandry went in to making horses faster, healthier, stronger, and more durable.
I think the quote you’re looking for is “if I had asked people what they wanted, the would have said faster horses”. It’s attributed to Henry Ford, although there is debate about whether or not he said it.
The point of the quote is that “faster horses” is the consumer response to “how do I get more work done” as it comes from the viewpoint of “how am I doing my work now”. An ingenious mind looks at the desired outcome and works backwards and may come to a different and dramatically improved solution instead of merely improving the current tool.
Things mature, and expectations grow appropriately. That is true of more than just LLM performance.
Sure, but it's good to have some perspective and some awe that any of this would've been absolute unbelievable magic just 3 years ago. Even if all AI progress stopped immediately, we'd need 10 years to digest and incorporate the technology.
Why look back in awe when technological innovation will just keep accelerating. Soon what we have today will seem quaint. Best to keep looking forward with impatience and discontent.
As someone who's been building developer tools (Visual Studio and Xcode) for 25 years, I don't have a perspective problem. We were doing "code completion" back in the 90s and could never have predicted that an LLM would write code at the current level of quality.
My point is that with every new model release, the expectations grow. I don't know how else to say that.
Welcome to human nature.