Because trans men have no advantage in men's sport, whereas trans females do. It's not even about trans people at all, it's about preserving fairness in women's sports.

Before trans issues were widespread in culture, intersex athletes were also scrutinized. Hell, I remember when people were questioning whether having a testicle removed gave Lance Armstrong an advantage...