The models they tested are already way behind the current state-of-the-art. Would be interesting to see if their results hold up when repeated with the latest frontier models.
The models they tested are already way behind the current state-of-the-art. Would be interesting to see if their results hold up when repeated with the latest frontier models.
I think we have all seen the latest models turn into a hot mess.
i interpret figure 2 as showing that incoherence increases with model gens, albeit on a small sample size