They still want you to hit the cache because their margin is higher on cache hits. That's actual compute they don't have to pay for and they don't have to have capacity for because they are supply limited on the compute side.

And the unit economics need to be there because there are competitors in the space. They can't just skin you on tokens or you'll jump ship.