I have seen people saying this for a long while now. I don't know how to say this but I understand Ai stuff better than non-Ai. When I see people complain ; I always wonder why because I think that its pretty good with my own senses.. Much much better than my writing skills... My brain has been tuned by computers I suspect .
I think the problem is that LLMs are verbose. They’re like business or self-help books— a lot of filler.
I understand what you are saying but I personally can't tell what it is that people like or dislike other than myself. In a way I accept differences in grammars and assay formation in any which way that is produced but some scientific journals written by humans are unreadable in one pass without reading them over and over. Ai produces much simpler language . To me Ai is saying things in the way that my brain can process quite easily.
I skimmed the paper, and it seems to be saying something different.
Basically, there are often different ways of putting a particular idea into words. Sometimes the longer way might be clearer, and the shorter way might be more confusing. If you care about being understood, sometimes you will use the wordy option. This is what humans usually do.
However, LLMs have context windows. All else being equal, verbosity eats up more context. If the LLM is trained (with reinforcement learning) to reason most effectively, it can do that by using terse phrasing. Especially on certain tasks that really need a large context window. Why? Because being terse is like getting a larger context window for free.
But in another sense, it's not really free. You're trading off clarity for context window. Sometimes you have to choose between verbose+clear and terse+unclear. If you're biased toward terse, that will also shift you toward unclear.
I do agree that LLMs are verbose sometimes, though. I think they are also trained to please the user, and they see sharing extra knowledge and insights as a way to do that. I don't think this idea is in conflict with what the paper says. If an LLM's training rewards both spitting out neat bonus info and doing reasoning that requires making the most of its limited context window, then that LLM may generate a large quantity of text which is written in a slightly terse and confusing style.
Have you read entirely generated documentation of code? I wouldn't say it's not understandable but it's no where near good quality human documentation.
I may have, don't know who is writing it, human or Ai.. All the same to me. If it has jargon though, I assume that it is humans.
I think it’s a reading comprehension level kind of thing. If I slow right down, it’s all there and understandable. But the quality of prose is terrible. It doesn’t lend itself to fast skimming. So it feels like I have to slow way down to understand it. To be fair a lot of humans at work write this poorly as well.