This is the only factor. People sometimes perceive Apple's NPU as "fast" and "amazing" which is simply false.
It's just that NVIDIA GPU sucks (relatively) at *single-user* LLM inference and it makes people feel like Apple not so bad.
This is the only factor. People sometimes perceive Apple's NPU as "fast" and "amazing" which is simply false.
It's just that NVIDIA GPU sucks (relatively) at *single-user* LLM inference and it makes people feel like Apple not so bad.