Merit isn't enough.
I went to a po-dunk school in rural Missouri. I would never be able to I compete with kids from a rich Chicago/NY school. In the same way a black kid from a poor inner city wouldn't be able to.
This is part of the problem. The world isn't egalitarian. The poor will continue to get poorer, the rich will get richer.
Solution? Lottery? Don't have a great one.