Look at it this way: a lot of smart people contribute to common goods, e.g. scholarly progress. So in a way, it'll benefit everyone.

I understand the counter-argument. But isn't a bit of a strange feature of the world that people kinda don't want more people to be produced with a higher IQ than themselves?