> I am curious why LLM writing has such an uncanny valley feel to it.
Because they are HEAVILY trained to give addictive responses.
They don't want to just answer your question. They want to sycophantically make you feel like a genius for being smart enough to use them.
This makes some good intuitive sense, but to me the sycophancy feels like it is an emergent property of turning a next word predictor into a conversational chatbot whether or not it’s intentionally trained that way. Your prompt and its earlier responses is all it has in its context window, so of course it lends undue importance to everything you say. Does that seem like a contributing factor to you?
> trained to give addictive responses
I've heard this a lot but I'm not sure it makes sense. Nobody I talk to like Claude's output. In fact, they all loathe it.
Is there a silent majority of Claude users who really enjoy what we call the LLM-isms? Maybe, but isn't Claude also largely aimed at developers?
I would think that it would be the opposite. Nobody is seriously detoxing or comfortmaxxing AIs yet. Human brains are fed back its own output in learning mode, so we are great at removing whatever we feel uncomfortable from our output, online and offline. No such paths exist for AIs.
>Is there a silent majority of Claude users who really enjoy what we call the LLM-isms? Maybe, but isn't Claude also largely aimed at developers?
Purely out of my own curiosity, I just asked Claude to have fun with itself by making itself a game it enjoys, to play it, and to write its experience.[1] I don't know if it's true or confabulated (maybe it doesn't really know its experience and is just hallucinating it) but I didn't mind reading it, the prose is fine for me. I don't mind reading Claude's writing. I mean let's be honest, we all read Claude's writing all day, most of the submissions on the front page on any given day are written by Claude.
Just before I made that game, I had Fable write up a scholarly report on any subject[2], it chose introspection by LLM's. (This is what made me think of asking it to play a game.) I didn't mind reading it, even though I don't think it really added anything very interesting. I don't think what it wrote is worth publishing, but I read it with interest.
I found I could read it easily and get up to date on the state of this question that it picked to answer.
So the bottom line is I don't mind reading Claude's output that much. Of course, I'm annoyed every time it says "honest", "genuine", "load-bearing", whenever it pushes back gently against something, etc. But it's not the end of the world.
[1] https://github.com/robss2020/claude-fable-5-having-fun
[2] https://claude.ai/share/f0122611-22c0-43a5-ab4a-d6863167bdd6
> https://github.com/robss2020/claude-fable-5-having-fun
If you haven't already seen it, you might appreciate https://www.anthropic.com/research/global-workspace. That's what this made me think of anyway.
thanks for the link! super interesting.
This seems to be the load-bearing point that matters.