[flagged]
13/s is not slow. Q4 is not bad. The models that run on phones are never 30B or anywhere close to that.
It is very slow and totally unimpressive. 5060Ti ($430 new) would do over 60, even more in batched mode. 4x RPi 5 are $550 new.
So clearly we need to get this guy hooked up with Jeff Geerling so we can have 4x RPi5s with a 5060 Ti each...
Yes, I'm joking.
13/s is not slow. Q4 is not bad. The models that run on phones are never 30B or anywhere close to that.
It is very slow and totally unimpressive. 5060Ti ($430 new) would do over 60, even more in batched mode. 4x RPi 5 are $550 new.
So clearly we need to get this guy hooked up with Jeff Geerling so we can have 4x RPi5s with a 5060 Ti each...
Yes, I'm joking.