That's quite slow I'm getting 8-12 t/s on a 13 year old CPU. (Speed varies by context size and other settings who knows)
https://news.ycombinator.com/item?id=48354801
Thank you for sharing / linking!
But OP is using Q8 and you're using Q4?
Thank you for sharing / linking!
But OP is using Q8 and you're using Q4?