My goto private setup, runs ~50t/sex on a dgx spark with sglang, nvfp4. Excellent model.
This is a meaningless metric without knowing how long the sex takes
30 seconds at most
This is a meaningless metric without knowing how long the sex takes
30 seconds at most