If NVIDIA had any competition we'd be able to run these larger models at home by now instead of being saddled with these 16GB midgets.
If NVIDIA had any competition we'd be able to run these larger models at home by now instead of being saddled with these 16GB midgets.
NVIDIA has tons of competition on inference hardware. They’re only a real monopoly when it comes to training new ones.
And yet…
Those are for the enterprise. In the context of discussion, end users only have Apple, AMD, and Nvidia.