> What is a task that is extremely high value, only require a small model intelligence, require tremendous speed, is ok to run on a cloud due to power requirements, AND will be used for years without change since the model is etched into silicon?
Video game NPCs?
Doesn’t pass the high value and require tremendous speed tests.
Speed = capacity = cost.
Video games are a huge market, and speed and cost of current models are definitely huge barriers to integrating LLMs in video games.