Are there plans to make much larger versions of this model? With 500B-1T params for general purpose knowledge tasks, similar to the current leading proprietary models?
Are there plans to make much larger versions of this model? With 500B-1T params for general purpose knowledge tasks, similar to the current leading proprietary models?
Stay tuned, this is just the beginning. Merging with Cohere will help in scaling, too.
How exactly would an open project do that?