I don't necessarily disagree with the idea that Harvard's admission practices should include other factors, but if they are receiving tax breaks there should be a federal / state-level monitor to evaluate the admissions practices. It's ridiculous to apply arbitrary criteria while they enjoy tax exempt status.
If an educational institution wishes to apply capricious standards, let them pay taxes.