it definitely feels like sooner than later there will be “Mythos level” cyber threats available on open source / uncensorable models. I think the only thing that can be done is continued work on hardening anything that is remotely close to “critical infrastructure” and software supply chain.

On one hand, self hosting will always be niche so you could pass a law like “if your serving inference at scale you need to have safeguards/ classifiers in place” since > 95% of inference will go through hosted services in the long run … but that could turn into thought policing dystopia real quick.