I find it curious when people agree that X doesn't matter, but then they go about and compare outcomes based on X

in this case X=sex but it could be race, age, etc.