> prices will probably 10-15x soon as foreshadowed with both API price policy changes from all the big providers

I'll take a sportsperson's bet with you that prices per unit of inference will be far far cheaper in one year from now then they are today. I think the trend of cheaper for better/equal inference quality will continue hard.

I'm sorry, but: why?

Hardware prices have spiked.

I know software is optimized over time but it's a very slow process.