I could be wrong but I think we crossed the 1 billion parameter threshold in 2019. I'm not sure we had this ability for decades.

They mean with traditional hard computation, not LLM magic.