“But they’ve added RL so…!!!”
You are obviously right and I see examples of it everywhere.
E.g I asked Claude opus 4.7 (the latest/greatest) the other day “is a Rimworld year 60 days?”. The reply (paraphrased) “No, a Rimworld year is 4 seasons each of 15 days which is 60 days total”.
Equally, it gets confused about what is a mod or vanilla since it is just predicting based on what it read on forums, which are clearly ambiguous enough (to a dumb text predictor).
Maybe there was more in the context before that question? I just copy-pasted that question into Opus 4.7 and it replied:
And that is the reason why it is only autocomplete. You probably had less context than the poster before, so it could not mix stuff up. The poster before either had more memory or the search searched through more topics. And btw it’s really hard to only give access to some things.
Not even deterministic autocomplete.
Good job a handful of companies aren’t investing a trillion+ dollars in that.
Can you imagine how silly they’d look when everyone realised.
"Everyone is doing it ⇒ it must be right." See also: bloodletting, leaded gasoline and parachute pants.