When I talk about fundamental limitations, I mean limitations that can't be solved, even if they could be improved.

We have improved hallucinations significantly, and yet it seems clear that they are inherent to the technology and so will always exist to some extent.

“Seems clear” based on what?

For one, based on continuously frustrated hopes (and promises!) that hallucinations will go away.