Are the populations of humans that don't have this problem (e.g. the Amish)? Seems like it would be a good clue if we're poisoning ourselves.
It's essentially impossible to stay away from contaminants now.
There have to be variations globally we can find. Although, the cause seems rather obvious, the only unclear part is the magnitude of effect.