You could do it but there would be no point, The only advantage over would be power consumption. And it would be quite expensive.
At the rate models are improving, it would be obsolete in six months.
You could do it but there would be no point, The only advantage over would be power consumption. And it would be quite expensive.
At the rate models are improving, it would be obsolete in six months.
Yes, right now it would be obsolete in six months, but I also must add that this never stopped crypto miners from making new ASICs. However, with how useful Kimi is right now - at some point if someone makes a dedicated hardware board with "good enough" model for daily tasks - that would be a very sought after commodity.
Power consumption and latency are very important on mobile
They're important everywhere of course, but especially on mobile. If AI researchers figure out how to offload knowledge and expertise from reasoning weights, then a core reasoning ASIC linked to the knowledge would totally rock.