I thought it might just be the rocket equation. Bigger planet = very little of the rocket is payload.

If most planets are bigger than Earth, then most civilizations will be like "muh we can do it but what's the point?" and they'll be content with just having a few science experiments in orbit, and that's all.