> For 15k you could run the best open source models (that would require 200k in hardware to run) 24/7 at 50 tps for like 5 years straight.
Is this assuming no price increase and no throttling ?
> For 15k you could run the best open source models (that would require 200k in hardware to run) 24/7 at 50 tps for like 5 years straight.
Is this assuming no price increase and no throttling ?