From my pov and after using AI a lot to better understand its usefulness I see this discussion as totally misleading and irrelevant.

The elephant in the room is that even the best frontier models still produce errors.

This is a fundamental issue and should be discussed instead of some esoteric pseudo-scientific nonsense.

If the current systems can not produce reliable results they are useless. The promise of actual usefulness needs to be fulfilled in a very near future.