My perception of real problem is that the LLMs were generic purpose tool and the focus was to improve their information retrieval and prediction. And they were fed with all this data (including private with was otherwise not available to everyone) for training purposes. The security and privacy of stored information was not really the requirement of this whole endeavor and all of sudden in the real world they are finding that this is a must requirement if they want to sell these models to enterprise companies.

And now all these security efforts to manage data privacy are akin to lipstick on a pig, they are brittle, costly, one-off. There are no boundaries inside the LLM storage, the training data is not encrypted at all in the memory across the pseudo tenants