I have a couple of non-GPU servers with them and quite a few Heztner Cloud projects, but I never understood their GPU offering. They have just two (small) VRAM sizes and you pay per month, whereas the ones like Runpod have a large selection of whatever you need, and they are cheaper, and you can rent them for a shorter period like two weeks, no setup time. Am I missing something?
There are use-case for smaller models that fit in 20gb VRAM, like in database sentiment analysis and such.
Sure, my point you can get these cheaper outside of Hetzner, so I don't really understand who are these for.