The blog makes it clear that "standard" GPU here is in opposition to purpose-built hardware like Cerebras. The selling point is reaching the same order of magnitude in generative speed as those approaches.
What a lot of use on here are salivating for is the ability to run these on prosumer hardware at home. So we tend to jump to the conclusion that "standard" means "consumer-grade" because that's what we want to see.
Still, very cool work!
The GPU in my desktop. (A normal-ish decent gaming machine that runs LLMs and txt2img well enough.)
In contrast, not enterprise GPUs that cost as much as a car.
I guessed you thought about consumer GPUs. We are about standard datacenter GPUs indeed.
How would you classify a datacenter GPU as standard/non-standard? That doesn't seem to be a meaningful distinction. It's click bait.
The blog makes it clear that "standard" GPU here is in opposition to purpose-built hardware like Cerebras. The selling point is reaching the same order of magnitude in generative speed as those approaches.
What a lot of use on here are salivating for is the ability to run these on prosumer hardware at home. So we tend to jump to the conclusion that "standard" means "consumer-grade" because that's what we want to see. Still, very cool work!
thank you deflator, I understand this now! much appreciated
You know, Radeon 9800 pro ago