What are the usecase that you can think of because 3.77 tok/s is actually to slow and better call a cloud API to do the task
Any well defined problem would probably be of use. How often anyone comes across these without other help is anyones guess.
[dead]
What are the usecase that you can think of because 3.77 tok/s is actually to slow and better call a cloud API to do the task
Any well defined problem would probably be of use. How often anyone comes across these without other help is anyones guess.
[dead]