Can a 5 year old write a substantial program on spec, that passes the requirements and given tests, in a few minutes?
If not, then perhaps this comparison is not the be all end all.
"A ship is useless, it can't drive over land..."
Can a 5 year old write a substantial program on spec, that passes the requirements and given tests, in a few minutes?
If not, then perhaps this comparison is not the be all end all.
"A ship is useless, it can't drive over land..."
But it demonstrates that LLMs struggle with basic reasoning. A criticism of LLMs is that they're imitating without a understanding of what they're doing and without a clear plan, so this inability to solve a simple logic puzzle is very relevant. If LLMs didn't struggle with reasoning problems then something like ARC-AGI wouldn't exist.
5 year olds and ai both have jagged intelligence.
also its AI not "artificial code generation intelligence" . Ship is your view of the product to shoehorn into something specific.