The ability of the algorithm to absorb billions of dollars of training effort is itself the major breakthrough of the transformer architecture.