It seems to me that most of today's high impact "minds" come from relatively wealthy families compared to the world's average. They come from a small pool of candidates, compared to the vast world population as a whole that don't have the same opportunities. We basically throw away potential geniuses.
If we reduced poverty, corruption and unemployment, and made higher education available for everyone, we would increase that pool by billions of people.
We don't need more people in the world - what we need is to give those that are already here the opportunity to nurture their minds and have a place where they can apply them