I constantly have to work around the slowness of matplotlib when creating animated sequences for my scientific work (even with the Agg back end)

I too have felt that pain. Funcanimation is passible for a few datapoints but it really struggles with anything meaningful in real time.

How many points are you working with usually?

Not GP, but my datasets weigh in at around 2-20GB depending.