> It helps to know that LLMs don’t “reason”. They predict ..
Semantics. Prediction is the training objective. The ability to reason can be, and very arguably is, an emergent property of that.
> It helps to know that LLMs don’t “reason”. They predict ..
Semantics. Prediction is the training objective. The ability to reason can be, and very arguably is, an emergent property of that.
By that standard, human brains don't either. Our externalizations of concepts like language or symbolic structure allow us to do so. In the parlance of our times, we built our own reasoning harnesses because our intuition lead us to do so.
Even if that was true, you'd have to still prove it has emerged.
What would be your test to determine that?
Maybe it looks like reasoning, and maybe that's enough for some.
No. You're simply wrong.
Why would "reasoning" be an emergent property of prediction?
Predict multiple outcomes, induct across them, refine.
There's a lot of reasoning in the training data.
How do you predict without reasoning?
Where is the reasoning in linear regression?
Where is the reasoning in synaptic transmission?
There isn't, which is exactly the point: we do not yet understand the fundamentals behind reasoning.
Don’t we? We can build something which has all the output associated with reasoning.
I’d say we’ve figured out the fundamentals behind reasoning.
> We can build something which has all the output associated with reasoning.
Sure. A photocopier fed with a maths paper.
Flip a coin.
Why wouldn’t it?