Nor do they have to. Inference from different users is batched together.
Ok? Even if they're batched? Grid energy is batched too
Ok? Even if they're batched? Grid energy is batched too