It sounds like Harvard deals in merit and not egalitarianism, where merit considers the power you bring to the table and not merely your academic skill.
Here's the big difference between the upper-class kids and everyone below when it comes to admission's fairness.
Everyone else says "I worked hard as an individual, therefore i deserve to get into a good college."
Upper-class kids says "MY FAMILY worked hard, therefore i (as an individual) deserve to get into a good college."
The emphasis is WHO worked hard. Upper-class kids tend to ride on the coat-tails of their parents and grand-parents.