Right now, self-hosting is too expensive if you’re starting from scratch. We have an old EliteDesk that can run the most basic of models, but it doesn’t feel like it’s worth it. Electricity is also quite expensive in many places, it adds up.

If hardware prices ever come back to sane levels, eh… the Framework desktop with Ryzen AI might be interesting to play with.