If one group of humans (sex, race, whatever) were to be _vastly_ more intelligent than the other, then we may well simply not care about the question at all.
Consider animal welfare. We may care about the treatment of animals to some extent, but the idea that a cow should, say, be able to become a computer science major is laughable. It's not even on the radar.