> model's ability to intuit game rules naturally, like a human

This line of thinking terrifies me for the future of humanity...

If you look at pretty much every animal other than the intelligent 5, they cannot use tools. Tool use is a human superpower. The model writing a tool that does the hard work for them, at least to me, is a sign of intelligence (laziness is the mother of all invention).

Where this becomes really interesting is when the LLM can write novel tools to solve novel problems.

Trying to say that AI has to act like a human to be AGI is something that will end up with us humans going extinct from a digital intelligence we don't understand at all.