I don't know that anyone is asserting lead is the only culprit; socioeconomic trends are complex beasts.
To reject it entirely however flies in the face of a significant body of evidence: http://m.motherjones.com/environment/2016/02/lead-exposure-g...