Also also genes that don't confer any particular advantage tend to peter out when inserted into large populations.
Above my pay grade but I think that argues that the genetic difference that do exist tend to either not confer any particular advantage, like maybe shape of your nose, hair color. Or confer some limited advantage, skin pigmentation for instance seems to be strongly associated with solar radiation and dietary availability of Folic Acid and Vit D.