> You have to include all the costs associated with the model, not just inference.
The title of the article directly says “on inference”. It’s not a mistake to exclude training costs. This is about incremental costs of inference.
> You have to include all the costs associated with the model, not just inference.
The title of the article directly says “on inference”. It’s not a mistake to exclude training costs. This is about incremental costs of inference.
Hacker News commenters just can't help but critique things even when they're missing the point
The parent commenter’s responses are all based on a wrong understanding of what unit economics means.
You don’t include fixed costs in the unit economics. Unit economics is about incremental costs.
I know I'm agreeing with you. I'm saying, don't bother with him lol
Your comment may apply to the original commenter “missing” the point of TFA and to the person replying “missing” the point of that comment. And to my comment “missing” the point of yours - which may have also “missed” the point.
I’ve clearly “missed” the point you were trying to make, because there’s nothing complicated: The article is about unit economics and marginal costs of inferences and this comment thread is trying to criticize the article based on a misunderstanding of what unit economics means.
I was not trying to make any point. I’m not even sure if the comment I replied to was suggesting that it was you or the other commenter who was missing some point or another.