I think “taste” is probably the right word. Steve Jobs’ quote about Microsoft is very relevant: “The only problem with Microsoft is they just have no taste. They have absolutely no taste. And I don't mean that in a small way, I mean that in a big way, in the sense that they don't think of original ideas, and they don't bring much culture into their products.”

Replace Microsoft with LLMs and the same quote applies. They have no culture, no connection. The code or comments they produce will not effect any future LLM session and they current have no concern how it will effect future humans except for maximizing engagement for the human at the console today.

Fiction is no different. Unless there’s a feedback loop the LLM just spits out text and will never see it again. The LLM will never meet the readers at book signings, weave in personal details that could only be known for experience.

It’s probably perfect for the write-by-committee style of movies and shows being created today. Just like organic food or locally made products, there are already creators putting Human Intelligence badges on their work and there will probably be a market (though niche) for that until human supremacist laws push it underground.