Tangential rant: I find myself getting viciously angry when these support bots lead with, "I'm very sorry to hear that. I understand how [rehashed summary of complaint] would make you feel frustrated." Mother ****er, you don't understand what it means to feel anything.
I'm all for having these bots process inquiries if it means a speedier resolution, but, please, anyone out there using these things, turn off the simulated sympathy. It's infuriating how condescending it comes across.
> getting viciously angry when these support bots lead with, "I'm very sorry to hear that. I understand how [rehashed summary of complaint] would make you feel frustrated."
The bots are specifically trained to do this because lots of people are dumb enough to prefer it that way.
It's something ELIZA could do in the 60s, and that worked unsettlingly well for an unsettling fraction of people who tried it.
I still think LLMs should be banned from using first person pronouns
(yes I understand this is likely not legal or practicable)
The models can predict any conversation, so it probably doesn't matter to them. For us humans it would be much better to let them write in the third person (e.g. "the coding assistant needs to verify XY, it does it by calling `grep -i abc`). It would decrease the anthropomorphism.