There are two different things occurring here.

One is how much does it cost OpenAI to train the model.

The other is, if I stole OpenAI's model how much would it cost for me to run it?

R&D costs versus operational costs. Operational costs are very likely profitable. R&D is catastrophically expensive currently.

There is also the cost of the inference hardware that gets ignored because they already have it from training.

The main problem with the scenario of just doing inference is it relies on nobody else training models better than yours. As long as people are training private models that are better than yours, just inference isn't a viable business model.