Be careful about unofficial providers, a lot of them misconfigure models or stealth quantize them. For a while the difference between Kimi on the official API and most third party providers was 20-40%.
Be careful about unofficial providers, a lot of them misconfigure models or stealth quantize them. For a while the difference between Kimi on the official API and most third party providers was 20-40%.
Kimi K2 had a vendor verifier: https://github.com/MoonshotAI/K2-Vendor-Verifier
(there's a table which shows comparison between vendors)
Also, it seems there's a general one as well (for all kimi models?): https://github.com/MoonshotAI/Kimi-Vendor-Verifier
OpenRouter should be penalising or banning for this.
They have an "exacto" category with providers they supposedly verified
That’s only for tool use.
This is my biggest complaint about OpenRouter and I'm a fan. Might be pretty tough at scale?
Would that align with their VC-backed incentives?
If your users can't trust your product then I'd say that'd be a pretty strong incentive?
the 2 I mentioned both have a fairly large following, who run benchmarks and absolutely will spot issues.