Yes, even many of the proofs seem to be extremely long and complicated. The Navier-Stokes proof is 57 pages of very dense math and a pretty crazy amount of code: https://github.com/openai/NavierStokesAndEuler/tree/main/Nav...
Given the close relationship between compression and intelligence, I'm somewhat surprised at how poorly the cutting edge models do with being concise.
You know, the first time you navigate somewhere (if you don't already have perfect directions) will probably be the longest route you'll ever take to get there
For Earth, the proof presented for NS is just our first attempt navigating from our previously known facts to the proof.
I expect we will be able to shorten it dramatically (most likely with human and AI insights), but I don't think we should read too much into the length. If you want a similar point of comparison, see the original proof (by humans) of Fermat's last theorem. It has been shortened significantly. This is normal.
> The Navier-Stokes proof is 57 pages of very dense math
> how poorly the cutting edge models do with being concise
LLMs solve a Millennium prize problem. People complain the proof is too long, within a week. What a time to be alive!
Deep commentary on an unverified proof of this level requires extreme expertise. So the existence of some shallow commentary is uninteresting; it doesn't actually imply pettiness or deflection or anything like that because it's so hard to make your commentary any deeper at this time. And no we shouldn't expect people to say nothing.
My observation isn't that solving a Millennium prize problem is not impressive.
It is the mechanism the LLMs use to do it. They seem to accel right now at quantity of work over quality of work. I'd be willing to wager there is a much simpler way to achieve the proof.
I've also seen this with code, LLMs do get the job done, but they tend to write 10-100x more code than humans to get the same job done. Still a massive value gain because they can write that much code extremely quickly.
"if llms are so intelligent why is cancer still not cured?"
I'm waiting for the inevitable: "Well, LLMs only cured a few types of cancer"
Then: "LLMs only cured cancer as a marketing stunt."
>I'm somewhat surprised at how poorly the cutting edge models do with being concise.
because they're not intelligent in the sense you're hinting at (conceptual integrity or generalization) but they are as the name suggests, large. Like comparing a forklift to a human. It's easier to bulldoze through a lot of things than tie your shoes.
If we weren't quite as impoverished conceptually and still had the vocabulary of the Catholics we'd recognize this as ratio (discursive knowledge) vs Intellectus (apprehending knowledge)
What an incredibly useless comment. You state a conclusion as fact without any supportive reasoning/evidence.
Prove that human intellect is different and that we solve problems using fundamentally different processes. I’m waiting.
"Prove"? Like, a formal proof, about intelligence?
yeah you know, that concept we've never been able to define using language, making heavy use of the human experience which can also not be captured in language (proof: how bad LLMs are at poetry)
the question is, when comparing a human and a large language model, whether the intellect (that cannot be captured in language) is different from anything the language model can actually do (e.g. language)
the answer to this seems quite obvious to me, and I would actually posit that the onus is on the other side, to prove they are even remotely similar
maybe people think that the voice in their heads is what is doing the thinking? is that the confusion here?
Do you think the LLM is the Chain of Thought? Did you also get confused by the name? Because, much like humans, the CoT is a tool to narrativize and maintain internal coherence. The actual thinking happens invisibly, in the forward pass. Just like...
>You state a conclusion as fact without any supportive reasoning/evidence.
No, it's the other way around, it's a reductive view on intelligence that mistakes its own methodology for ontology.
It's obvious to see that there's no intellect in an LLM as defined above because of how they work. LLMs put one token in front of the other, they don't work towards formal ends, there's no intentionality in them. They don't synthesize the information they process into a unified experience. Thinking an LLM can apprehend what it does because it can process large amounts of text is like thinking your TI-83 understands math because it can multiply large numbers.
That's also why the failure modes of LLMs are what they are. They can churn out tens of thousands of lines of code but also just as easily go in circles like a roomba. They can process an entire encyclopedia but not solve problems a 10 year old can solve.