Barack Obama went to Columbia, which is literally in the same league as Harvard. He also went to Harvard Law after undergrad, so I don't think he fits your narrative.

We don't need to include how an elite university selects their students to claim that they are going to miss a lot of brilliant and innovative people. The mere fact that they admit only thousands of people a year make this necessarily so.