What’s wrong with shipping a local llm? This is quite nice IMO is there a privacy concern with running it locally? I already have a few games I wrote web based using this and it’s quiet nice to not need a server to run my game in pure HTML from my file system
Because it's huge and people were counting on having that disk space.
4gb? Maybe on a raspberry pie it’s a problem - I’m sure there is a chrome flag to disable