> Most people are already used to rely on the internet on basically everything

FAANG has trained them well. "Normal" people also use chatGPT & co. to ask mundane questions that qwen27b could easily answer (random trivia, writing emails, correcting translations etc), why do these simple requests need to be processed on a B300 on server on the other side of the planet? There is no reason.

And this being hackernews, I would expect people here to go against the grain in this regard...maybe even promote local llms to "normies".