You might be conflating throughput with latency. 100k tok/s is very different to 1 tok/10us.