This is a tell of LLMs but it's not universal. I use ChatGPT extensively and I don't often get obvious nonsense any more.

I'd figure out that it's an LLM because it's effectively superhuman. Taking that away I'm not so sure I'd be able to tell