Ultimately the existence of elite universities is the root of the problem. Most colleges take a huge majority of the students who apply, so neither legacy students nor affirmative action make too much a difference for them. Universities should be more like this and less like incubators for the ruling class.
All of the drama recently revolves around wealthy students being denied their rubber stamps or underprivileged students being denied their golden ticket. It’s bad that college performs these functions, so let’s work to fix that.