> What class of software can work this bad and still have people convinced the only solution is to double the amount of compute and data they need, again?

Cloud providers :)))

And chip producers