Apple's Foundation models seem great on paper until you see the 4k context window. (though I know we are still early in this chapter).