$2k? LOL. That's not even the GPU budget, these days.

The economies are currently out of whack because of underproduction of components and memory, so LLM providers have a few years of runway to entrench. Plus, the whole capex Vs opex thing that helped AWS will help here too, for sure.

At some point, though, things will change. More production will come online, and providers will have to end the current speculative subsidizing and jack up prices.

It's a bit like the dot-com era: the initial rush to land-grab web portals and e-commerce sites eventually died, once enough skills and infrastructure came online, and the bubble burst.