The things in LLM “knows” are not infinite per its physical size. “Experts” don’t exist in a world where hardware capacity was a trivial issue.

in two years, yes I expect us to have much better models. Perhaps many times more efficient. But not 100 times.