"The Bell Curve" way back in the 90s touched on the many ways substantially above average IQ appears to be maladaptive. You get much more than 1.5 standard deviation for the parents on IQ and infant mortality actually spikes.
Also various neuro diseases appear strongly correlated to IQ of the parents, like tay-sachs, for example.