In fact, does anybody want to hire a server with me? I suspect it'll work out cheaper than Claude max etc: a server from hetzner starts at £220ish: https://www.hetzner.com/dedicated-rootserver/matrix-gpu/
It might be fun to work out how to share, too. A whole new breed of shell hosting.
I have a couple of non-GPU servers with them and quite a few Heztner Cloud projects, but I never understood their GPU offering. They have just two (small) VRAM sizes and you pay per month, whereas the ones like Runpod have a large selection of whatever you need, and they are cheaper, and you can rent them for a shorter period like two weeks, no setup time. Am I missing something?
There are use-case for smaller models that fit in 20gb VRAM, like in database sentiment analysis and such.
Sure, my point you can get these cheaper outside of Hetzner, so I don't really understand who are these for.