> The main bottleneck at this point is the cost of all of the token
Are you using Chinese models? Quite a bit cheaper, but maybe still too expensive?
> The main bottleneck at this point is the cost of all of the token
Are you using Chinese models? Quite a bit cheaper, but maybe still too expensive?
Yeah mainly deepseek, it performs near top pretty consistently in terms of price/output (with a basic quality measure). I would love to test with more models but that's not cost-realistic for me at the moment.