A long time ago I worked in the video codec area and was shown then that the most difficult videos to compress (i.e. with the most compressed bytes resulting in the file) were cartoons, because of the sharp edges, etc.

Not sure if it is still the case today with the latest generations of ultra-advanced codecs.