Sorry for the dumb question, but is there any useful non-trivial LLM that is open-source where you could bit reproducibly train it from sources?
Sorry for the dumb question, but is there any useful non-trivial LLM that is open-source where you could bit reproducibly train it from sources?
Yes, quite a bit, but you can lookup OlMo from allen.ai for starts