Frontier models don't fit on a normal GPU. The datacenter architecture frontier labs use is not a commodity. What you're describing is beyond the state of the art, and if we go there then anything is possible.
Frontier models don't fit on a normal GPU. The datacenter architecture frontier labs use is not a commodity. What you're describing is beyond the state of the art, and if we go there then anything is possible.
When I think of a GPU I think of an Nvidia rack kit. What do you think when you think of a GPU?
Most of the latest models are too big to fit in a single GPU instance.