The money will go to LLMs.
Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested
You will need 100s of billions to make a viable POC.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
Let's wait 10 years and see.
In 10 years the world will not be the same.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.
Why not both? You don’t need 1trillion allocated before you have a proof of concept to demonstrate your non-LLM model, and once you have a PoC you will definitely have the larger investors interested
You will need 100s of billions to make a viable POC.
For a PoC? That sounds very unlikely. I think you’re off by at least 2–3 orders of magnitude
Let's wait 10 years and see.
In 10 years the world will not be the same.
You only need to train a range of small models in order to establish a plausible scaling law, IMO.