> AI has reached a state of software issue, not hardware
Citation very much needed.
At the very least, OpenAI seems to believe more and larger datacenters is the path to better models... and they've been right about that every time so far.
> AI has reached a state of software issue, not hardware
Citation very much needed.
At the very least, OpenAI seems to believe more and larger datacenters is the path to better models... and they've been right about that every time so far.
Moreover, all the frontier labs and hyperscalers are capacity constrained, and will be for the foreseeable future.
>OpenAI seems to believe more and larger datacenters is the path to better models...
Does that mean they produce better slop, or more slop faster?
Better slop. The effect that these systems get better as you scale up [0] is real you know.
[0]: https://arxiv.org/pdf/2001.08361