There are use-case for smaller models that fit in 20gb VRAM, like in database sentiment analysis and such.
Sure, my point you can get these cheaper outside of Hetzner, so I don't really understand who are these for.
Sure, my point you can get these cheaper outside of Hetzner, so I don't really understand who are these for.