And to your point... yes?
If someone said a profession mostly working outside in the desert has less gingers in it because most of them are biologically unsuited for prolonged sun exposure, would you really take offense?
This isn't phrenology we're discussing here. If you're discussing real, tangible biological differences backed while proper scientific research, while taking care to treat people as individuals and avoid generalizing based on the distribution mean, then what's actually the problem here?