Take anything from Microsoft with grain of salt. Remember Phi?
They can’t decide on naming their product in Azure, let alone creating something useful or usable
Take anything from Microsoft with grain of salt. Remember Phi?
They can’t decide on naming their product in Azure, let alone creating something useful or usable
Phi was pretty revolutionary for its time. The accompanying paper https://arxiv.org/abs/2306.11644 has been pretty instrumental in pushing the idea of highly curated synthetic dataset to train model. The lead scientist behind Phi-1 is now VP at OpenAI and leading their own synthetic training dataset effort.
Phi was smart (or had a smart training architecture, more precisely), and arguably pushed the conversation forward globally on the value of curated training data.
Remember Tay AI?
https://knowyourmeme.com/sensitive/memes/sites/tay-ai
I love this video on Tay
https://www.youtube.com/watch?v=HsLup7yy-6I
Phi was cool for what it was. But it's not 2024 anymore.