It’s kinda misleading to omit the generally terrible prompt processing speed on Macs
30 tokens per second looks good until you have to wait minutes for the first token
It’s kinda misleading to omit the generally terrible prompt processing speed on Macs
30 tokens per second looks good until you have to wait minutes for the first token
The tweet I linked to includes that information in the chart.