Can you do basic addition of 2 arbitrary numbers with 100% accuracy (no tools) ? No you can't. You will make mistakes for a sufficiently large N even with pen and paper, and a very small N without. Are you no longer generally intelligent ?

Somewhere along the line a $10000 GPU has to be equivalent to using a finger to do arithmetic in the dust.

No, but I can develop methods to eventually do it.