Where did you get your free GPU from?
The problem is the same as owning the house vs. renting.
I just use my AMD Framework 13 and 24GB M4 Mac mini. They run gpt-oss models, but only the 20b fits on the mini.
GPUs can do other things. Cloud service LLM providers cannot.
The problem is the same as owning the house vs. renting.
I just use my AMD Framework 13 and 24GB M4 Mac mini. They run gpt-oss models, but only the 20b fits on the mini.
GPUs can do other things. Cloud service LLM providers cannot.