You will need 100s of billions to make a viable POC.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
Let's wait 10 years and see.
In 10 years the world will not be the same.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
Let's wait 10 years and see.
In 10 years the world will not be the same.