What if Women, on average, prefer to take more time away from work due to having a child than their male partners? And what if "Black" people are, on average, younger than other groups and so are more likely to be in early-career roles?
More broadly, once we start dividing "People" up into groups like "Black" "White" "Man" "Woman"; isn't a bit silly to think the groups won't expect and want and do different things? Like even if we assign people literally at random (and 'Race' isn't much different than this); wouldn't differences emerge?