I think the point is that whole collectively one group may be more privileged, people are individuals and not a collective.
For example a black child born into extreme or moderate wealth is undoubtedly more privileged than a white child that is orphaned at a young age.