In a word: so? Intersex people exist, you have to draw the line somewhere, the presence of SRY seems as good as any.