Even though they arent Nvidia GPUs I wonder if setting up a swarm of Intel GPUs would be worthwhile for a similar setup, more VRAM, more diverse models.
Even though they arent Nvidia GPUs I wonder if setting up a swarm of Intel GPUs would be worthwhile for a similar setup, more VRAM, more diverse models.
Using OpenVINO and a supported model can get you surprisingly far...
Nice, not sure why I was downvoted for suggesting the cheapest GPU which comes with quite a lot of VRAM... but I guess some people are fatigued by AI / GPU talk?