Perhaps actual thinking is not automatically necessary for that either! - and the LLM is proof.

Then what is thinking necessary for? Not for proving novel results; not for coding; not for writing prose; not for arguing a point; not for interpreting artworks; etc.

> not for writing prose; not for arguing a point; not for interpreting artworks

To be fair, LLMs are pretty bad at all of these. They struggle to avoid cliches and to produce prose with actual substance (below a stylistic facade that is undeniably convincing).

They struggle to avoid cliches and to produce prose with actual substance

I have bad news for you about the writings of most Ph.D.s and University professors...