"The missing piece is how to identify over-specialization, and it's missing because it can't be usefully generalized."

If you read the literature on selective breeding they have extensive methodologies for avoiding genetic problems. If you just want a quick overview, Temple Grandin's book "Animals in Translation" has a couple of really entertaining chapters on the subject.