I think parent poster was referring to the open secret that the early models were trained on massive collections of pirated novels and textbooks.