I don't ever want to be dependent on a cloud service to be productive, and I don't want to have to pay money to experiment with code.
Paying money for probabilistically generated tokens is effectively gambling. I don't like to gamble.
I don't ever want to be dependent on a cloud service to be productive, and I don't want to have to pay money to experiment with code.
Paying money for probabilistically generated tokens is effectively gambling. I don't like to gamble.
Where did you get your free GPU from?
The problem is the same as owning the house vs. renting.
I just use my AMD Framework 13 and 24GB M4 Mac mini. They run gpt-oss models, but only the 20b fits on the mini.
GPUs can do other things. Cloud service LLM providers cannot.