I bet there's some way to make the GPU do the color conversion. It's not like it's doing much otherwise...

It looks like copying from EFB to XFB can do an RBG to YUV conversion automatically.