It's not unrealistically pessimistic. We're already seeing research showing the negative effects, as well as seeing routine psychosis stories.
Think about the ways that LLMs interact. The constant barrage of positive responses "brilliant observation" etc. That's not a healthy input to your mental feedback loop.
We all need responses that are grounded in reality, just like you'd get from other human beings. Think about how we've seen famous people, businesses leaders, politicians etc go off the rails when surrounded by "yes men" constantly enabling and supporting them. That's happening with people with fully mature brains, and that's literally the way LLMs behave.
Now think about what that's going to do to developing brains that have even less ability to discern when they're being led astray, and are much more likely to take things at face value. LLMs are fundamentally dangerous in their current form.
Yes this is flaw on we train them, we must rethink on how rewards reinforced learning works but that doesn't mean its not fixable, that doesn't mean progress must stop
if the earliest inventor of plane think like you, human would never conquer skies we are in explosive growth that many brightest mind in planet get recruited to solve this problem, in fact I would be baffled if we didn't solve this by the end of year
if humankind cant fix this problem, just say goodbye at those sci-fi interplanetary tech
Wow. That's... one hell of a leap you're making.
Obsequiousness seems like the easiest of problems to solve.
Although it's quite unclear to me what the ideal assistant-personality is, for the psychological health of children -- or for adults.
Remember A Young Lady's Illustrated Primer from The Diamond Age. That's the dream (but it was fiction, and had a human behind it anyway).
The reality seems assured to be disappointing, at best.
The irony of this is that Gen-Z have been mollycoddled with praise by their parents and modern life, we give medals for participation, or runners up prizes for losing. We tell people when they've failed at something they did their best and that's what matters. We validate their upset feelings if they're insulted by free speech that goes against their beliefs.
This is exactly what is happening with sycophantic LLMs, to a greater extent, but now it's affecting other generations, not just Gen-Z.
Perhaps it's time to rollback this behaviour in the human population too, and no I'm not talking reinstating discipline and old Boomer/Gen-X practices, I'm meaning that we need to allow more failure and criticism without comfort and positive reinforcement.
You sound very old man yelling at cloud. And the winner takes all is so American.
And no discrimination against lgbt etc under the guise of free speech is not ok.
Well you're wrong on all accounts of the veiled insults.
Also, I've not stated LGBT, this has nothing to do with it, it's weird you'd even mention it.
Sorry that was indeed uncalled for. It's just the "kids need to be tough again" narrative I have an issue with. That's especially coming from conservative Americans right now. We have so much wealth in the western world, it doesn't have to be survival of the fittest.
I personally feel we should be way more in touch with our emotions especially when it comes to men.