I expect the bitter lesson to continue to be bitter. Mistral must at least attempt to catch up to SOTA 6 months ago.
Do they really? "SOTA" is great for development and creating content but for industrial needs.... perhaps they are not really "SOTA"?
It follows directly from the bitter lesson - a frontier model can be relatively cheaply distilled into anything you need to run quickly (and a frontier model like Mythos will help you distill it quickly), decidedly not true the other way around.
Do they really? "SOTA" is great for development and creating content but for industrial needs.... perhaps they are not really "SOTA"?
It follows directly from the bitter lesson - a frontier model can be relatively cheaply distilled into anything you need to run quickly (and a frontier model like Mythos will help you distill it quickly), decidedly not true the other way around.