You can amortise the training cost across billions of inference requests though. It's the marginal cost for inference that's most interesting here.