>I’m not sure how they did it

TPUs absolutely dumpster Nvidia cards, for the same reason that mining bitcoin is done with ASICs instead of cards.

So yeah, just more training, more data, and so on.

If Google wasn't so cloud focused, they could take over the AI Chip market lead from NVIDIA.