> Is there something more we need to understand?

Only if you're interested in the specific failure modes that LLMs have.

That's all this story is.