the huge demand exists right now because the cost of a token is near zero. and companies have figured out one weird hack to gaining value in the stock market, which is to brag about how many tokens are being crammed into all manner of places that they may or may not belong.
customer value must eventually flow out of those datacenters in the opposite direction to the the energy and capex that are flowing in
do people actually want all this AI? I see studio ghibli portraits, huge amounts of internet spam, workslop... where is the value?