yes, with qwen3.8-27b-4bit run via rapid-mlx i can get to about 200k
Nice.. and how many toks/sec?
Around 20
Nice.. and how many toks/sec?
Around 20