One of the depressing things about this is that they’ll also confidently repeat a consensus that’s in their training. This is particularly obvious when there’s been a new event just past their training cutoff, and they confidently tell you that can’t be true.
I mean, this is true of any kind of model that is not continuous learning. This is also true of people when the change in information conflicts with a deeply held belief of theirs.
I was slightly accelerationist until I got into an "argument" with Gemini! The aggressive gaslighting and "lies" that it tries to use genuinely makes me worry about the future with AI.