Causality runs both ways here, though. Stress is known to damage the brain, stress leads to substance abuse which damages the brain, pollution exposure is known to blunt cognitive function, shift-work is known to damage the body, bad childhood nutrition and bad health of the parent during natal development. Factors that would add up to some level of brain damage.