imo this is the problem some of these labs are gonna face, because open models will do this just fine and you as the consumer don't need to pay their training costs
especially considering imo most use falls under this instead of those kind of tasks where you'd need the SOTA
Yeah. Sometimes I wonder who the long term financial winners will be from the ai boom. It might be ram / gpu manufacturers. Or whoever cracks putting LLMs on asics.
It's going to be the shareholders of the first companies to crack AGI, and make human brains fully irrelevant economically. With the trillions of dollars that's going in through both investment and users, it's going to happen. I don't believe the human brain has fundamental magic that will make this impossible.
> It's going to be the shareholders of the first companies to crack AGI, and make human brains fully irrelevant economically.
What makes you think if one or two AI labs can do this that the rest (including open model providers) won't be able to follow the same path a few weeks/months later?
Even if you believe in the "Singularity", and believe it is coming soon, I still don't see any reason to believe the Singularity will be... singular. There won't be one clear winner.
None of the AI labs are showing any sign of pulling away, to the contrary the early large leads have all been evaporating.
AI has clear economic value. It still isn't clear at all how the providers of AI will capture that value as the technology becomes rapidly commoditized.
For the downvoters: What magic do you think the human brain has that makes it impossible to emulate acceptably?
LLMs are not emulating the human brain. Somebody may well be able to do that someday, but right now nobody is even trying to.
Why would you need brain emulation to get superhuman intelligence?
Are you making a serious argument that superhuman intelligence is a plausible outcome of training LLMs on everything humanity knows so far? Or are you making the generic assertion that AGI is theoretically possible via means other than emulating the human brain? Because the latter is a strawman (nobody has asserted anything to the contrary), and I have seen no evidence at all to support the former.
I think we can compare the human brain and LLMs on a bunch of capabilities today, and see how we compare. By my reckoning:
- LLMs have better long term memory (they know more than any human) and more working memory (LLMs have fast, uniform access to their whole context window).
- LLMs are faster than we are.
- Humans have online learning (we can do simultaneous learning and inference), giving us advantages in many novel tasks.
- We can learn concepts from far less data. And we can manage our mental context more smoothly.
- We seem to have better world models than current models. AI video just doesn't look right, somehow.
I expect that these remaining weaknesses can be overcome without resorting to human brain emulation. I see no reason to think that current LLMs are at the limit of what technology is capable of.