I suspect in 5 years everyone will have the equivalent of a 512gb mac mini running a 500b class open weight model for 98% of their tasks, shelling out to openai/anthropic for the other 2%. People who need higher end models will own the equivalent of 4 x 512gb mac mini running a 2.8T class open weight model. I don't know where OpenAI and Anthropic are going to get their revenue from to keep developing SOTA frontier models at that point.