> Trained from scratch
How are they training without pirating the Z library corpus and all that?
I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text
Right but how did they get a corpus, how do they compete legally without distillation?
[dead]
I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text
Right but how did they get a corpus, how do they compete legally without distillation?
[dead]