It will be like the rest of computing, some things will move to the edge and others stay on the cloud.

Best choice will depend on use cases.

I think the long term will depends on the legal/rent-seeking side.

Imagine having the hardware capacity to run things locally, but not the necessary compliance infrastructure to ensure that you aren't committing a felony under the Copyright Technofeudalism Act of 2030.