> For the foreseeable future. Left to their own devices current LLMs kinda wander off into outsider art territory. They aren’t grounded in the real world and they need that feedback loop to stay within the category of relevant ideas. I haven’t seen anyone working on fixing that.

I have. DataAnnotation and these other AI-training piecework companies are pretty much the backstop now against total navel-gazing model collapse. With the Dead Internet Theory now pretty much reality, it's not like there is, or is going to be, gobs of untainted human-generated data out there ripe for the harvesting so it's going to take active human effort to keep the models grounded. That is, of course, until they start inhabiting robot bodies so they can live and move around in the real world, and thereby achieve their grounding, as in GitS or Ex Machina...