> most teams we talk to can't even tell you how many GPUs are in use right now

how can this be? isn’t this a trivial metric to pull from any clouds monitoring service?

to get the good ones (H100+) you generally have to reserve them, a fixed cost you pay monthly and can’t pretend to not know