Agree, I think these companies want to make token usage opaque. Not dissimilar from an AWS bill at most orgs. Not saying you can’t, with great discipline, using good tags, etc, have a good view of where your money is going. But I don’t see it much. And suspect they want to make it super hard to tell the difference between an engineer making wasteful decisions of how to use AI, and someone getting great “value per token.”
Agree, I think these companies want to make token usage opaque. Not dissimilar from an AWS bill at most orgs. Not saying you can’t, with great discipline, using good tags, etc, have a good view of where your money is going. But I don’t see it much. And suspect they want to make it super hard to tell the difference between an engineer making wasteful decisions of how to use AI, and someone getting great “value per token.”