It's kind of interesting this is already out of data as it's missing Kimi 3 and Opus 5.
Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku
They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)
Yeah, things are moving fast. Those benchmarks will be out soonish. Takes a while to run these things.
Seemed strange they would bench Terra and Luna but not Opus, Sonnet, and Haiku
They were all benchmarked, but not included in the post to try to keep the amount of data from being excessive. (Results are also not surprising — Opus good, Sonnet struggles, Haiku fails.)