I don't care who King Charles is every single time
that's the trick and a multi-billion dollar question, how would an llm engine know that? it's an active research area how to cull the initial layer surface and do the optimal traversal path through the layers and it's a damn hard problem. It's definitely an area where a ton of performance is left on the table still.
Seems to me like there's a conflict of incentives in the current era of market capture.
Not to say the cost-cutting wouldn't be valuable; today's race is predominantly about the model's reasoning capacity or "how hard of a math problem can the model solve".
It'll be a nice day when research-oriented human capital gets redirected to things that benefit us layfolks's pockets more directly
This makes me think (by full ignorance) how quantum computing can be useful in this field of things reach a stable-ish point
they will not. quantum computers as understood today will never run an LLM. read = destroy. and no cloning. wanna reload the entire model for each token? preparing quantum states is slow by any standard.