Whatever differences there are when dealing with averages are usually irrelevant in human-scale interactions between a handful of people that are, in many cases, randomly distributed across various criteria.
If group X was found to be on average 5% higher in some particular measurement than another, what does that mean on a person-to-person basis? All it will do is bias people in their thinking. It's only when that percentage is quite extreme that it's actually significant.