Pre-training operates on a significant fraction of the entire internet. It’s simply not possible.