NVidia has less than zero reason to ship cards ideal for this at low prices.
AMD’s stock price reflects a hope they launch a CUDA alternative. But this is unlikely for the near future.
There is a lot of interest in preventing China coming in with cheap AI hardware.
So I expect the direction to be good local models that few can run effectively.
The Chinese will flood the market with cheap AI chips just like they did with EV cars. As consumers we can’t thank them enough.
It's already moving that way with Huawei AI chips.
I think it will eventually result in regulation and a potential grey market, and/or implosion of the centralized LLM services — I doubt they can keep hardware from becoming cheaper forever, and diminishing returns will make consumer hardware suitable for all but the hardest problems. At that point, the hardware “moat” will be completely gone and have become an extreme unrecoverable sunk cost.
Well you have tariffs and bans on EVs as well so surely there will be bans and tariffs as well on AI products and chips but for people who really want the chips and models we know they can get it. I expect a market like it used to be for pirated content
I'm cautiously optimistic that anti-conpetitive action against hardware will fail. There's a lot of money willing to fight for cheaper inference. The same can't be said for providing consumers with cheaper cars.
I can't say I'm as optimistic about there continuing to be an open market for foreign LLMs.