> Either way, Mistral is a failing company with little relevance in the AI space and that's not going to save them.

Already ? I was wondering when some US based company will buy them including all that "soverignity" prompts :)

Local llms are what we need and to get that we need memory so we need computer builders from outside of US. Why ? Because when something external appears US companies also allows US citizens to have that too at lower price :) Not before external forces force them to be suddenly good hearted to their own peoples...

Can we also have coarser MoE's ? If I want to code I do not need llm be trained on past and present capitol names and chemistry and everything unrelevant to the task ! Watch Matrix again ! We need somewhat "inteligent" llms and knowledge can be uploaded just like Neo learned kung-fu :) - prompts and light tr^h^hweek of learning and some exams, we need kind of university for llms :) So llms finally fit into users computers... And when some grandmas or snowflakes start to whine tell them to learn - llms usage can be a skill finally ;)

Edit:

Wait, can we have something like interchengable weights so knowledge can be just downloaded to model folder ? Common weights format ? Reproducible builds ?