Unless you care about FLOP/Watt, which big players definitely do.

No more than 5-10% of the hourly cost of an A100 will be in actual power. It’s not a big factor.