> I feel there is a potential to "distill" the frontier models into useful tools that can run on smaller hardware.

We already had many of those tools. They're called appliances. We've rolled them all into one and now we're making that one into a terminal of some kind of remote entity. Big mistake in terms of resilience and independence.