But Pi Zero has a GPU, so why not make use of it?

Because then you're stuck on that device only.