This is a good example of how the modern philosophy of identity politics falls apart when you seriously examine it.
Think of all the ways that people are innately privileged (or not): intelligence, height, beauty, upbringing, parental wealth, personality profile.
Any combination of the above can have a vastly greater impact on a person's life outcomes than race, gender, sexuality etc.