Ever read an article on a subject you’re very familiar with and notice all the mistakes?
When I ask ChatGPT* questions about things I don’t know much about it sounds like a genius.
When I ask it about things I’m an expert in, at best it sounds like a tech journalist describing how a computer works. At worst it is just flat out wrong.
* yes I’ve tried the latest models and I use them frequently at work