I wonder what this measures in J/token.
Assuming 30% gpu power utilization because of all the loading and unloading 29.2 kJ per token
Damn 15 AK47 bullets per token
Assuming 30% gpu power utilization because of all the loading and unloading 29.2 kJ per token
Damn 15 AK47 bullets per token