Interesting given this is the polar opposite of my experience. I find Googles AI overview to give wrong answers constantly. Occasionally, even for questions I believe Google circa 2018 was able to answer confidently.

Ironically, Googles AI overview often links to references that state the polar opposite of what the AI overview claims.

I've seen it answering based on a single Reddit, Stackexchange, or even HN source. Sometimes either incorrectly, or taking some side of a debated technical issue and presenting it like a fact.

[deleted]

Each Google "AI" response should state a correctness confidence value. A range 0-40% will probably suffice.

Just recently I read that it is futile to make AI give out scores like that, as they are pretty much completely made up. Can't find the article anymore, though.

Definitely. I was being ironic. Sorry not to say!