I am wondering if this is why they can offer their pro model at ~1/4th of the price compared to the other providers offering the same model, and if other providers will be able to do the same in a short timeframe.
I am wondering if this is why they can offer their pro model at ~1/4th of the price compared to the other providers offering the same model, and if other providers will be able to do the same in a short timeframe.
Inference I estimate runs 90% plus gross margins. Just work out the math on these servers. I am pretty sure any player can price down. It wouldn't look good on an IPO prospectus.
I have been heavily using DeepSeek V4 Pro at Max for a month now and I would say it is 100x cheaper. If I pay for Claude I will hit that limit so fast I am always waiting 5 hours. Using the frontier models at Kilo I go through dollars while doing the same thing via DeepSeek it is pennies.
I believe the comment you replied to was talking about the cost on providers like OpenCode vs Deepseek API. Deepseek API is even cheaper than the other providers for the same deepseek models.
It'd presumably help a lot, but also when you use their endpoint they get more training data.
This applies to every provider. OpenAI seems to be the worst hoarder.
actually you can buy inference on third party providers that serve deepseek v4 pro with zero data retention (ZDR).
Only reliable way to have zero data retention is to self-host.
True. But at some point you got to close your eyes and take a step forward.
It’s like with VPN providers. Is Mullvad actually collaborating with law enforcement? They very well could be. It is a calculated risk.
Is DeepInfra actually logging and training or selling the logs? They could be.
Mullvad has proved it doesn't collect. It's laughable to even suggest it.
They have been raided multiple times, tons of audits, does bleeding edge research on privacy preserving tech, donates to GOS, etc etc. You don't see this kind of VPN company at all because none exists.
With Mullvad the threat space is also different. Most of the data is end-to-end encrypted anyway with proven methods. With LLMs you can't do that yet.
How does one find trustworthy ZDR DeepSeek 4 Pro providers?
US labs do it too.
Name any 2 or 3 that published bleeding edge research and similar in the last 6 months.
Well I can't think of even one at the moment, to be honest might be biased but all Chinese research labs are largely oss except Alibaba now.
I am certain there are lots of American labs that claim to do it, but either they are marketting in hype since they aren't even close to the frontier or contrarily just don't make anything of significant value public/oss.
Google and Nvidia...
US labs are the biggest data broker in the current history. They collect everything, dumb fuck.