This is adapted from Microsoft research's YOCO. It was known for a while(2024!).
Yes, credit to Deepseek for actually scaling it up and releasing a frontier flash LLM.
Edit: the rest of this thread has become a US China infowar theory culture war. I am not of either of these countries and the above comment isnt meant to implicitly support either "side".
why didn't Microsoft scale its own invention?
Politics and profits.
Deepseek delivers 1 product; Microsoft delivers dozens (or hundreds depending on how you want to count it) across various domains.