It is not SOTA. Give me a break. Sure, run it on Cerebras to get speed but that’s pretty much its advantage.
Agreed. The benchmark closest to my experience is FrontierMath Tier 4. Fable and Sol (90%) are very far ahead of Kimi K3 (not even 40%). Kimi is trained heavily to basic agentic tasks, like all the other open models right now.
Why do you think it's not SOTA?
Cerebras does not share the quantization of the models so you don't know if you're getting real K3 or k3 lite or something else.
Agreed. The benchmark closest to my experience is FrontierMath Tier 4. Fable and Sol (90%) are very far ahead of Kimi K3 (not even 40%). Kimi is trained heavily to basic agentic tasks, like all the other open models right now.
Why do you think it's not SOTA?
Cerebras does not share the quantization of the models so you don't know if you're getting real K3 or k3 lite or something else.