> Their only mental model comes from science fiction, plus the simple fact that we possess a theory of mind.

That's an extreme downward punch. Have you not observed the marketing these LLM companies are themselves producing? They're intentionally misleading the public as to the capabilities of these systems.

> if people were able to casually not anthropomorphize LLMs

Of course they can. You just need to train them appropriately. No one is doing that. Companies are busy running around talking about the "end of coding" or the "end of work" because some extremely chinsy LLM models are around that they want to _sell you_.