To provide inference, Anthropic and OpenAI need to also constantly spend resources on training new models.

If either one of them stops doing that, customers will stop using them, because other models will become better.

In other words, there is no point in talking about inference cost in isolation.