Part of my explanation would be that you can only insult a person with their compliance. If they become offended or defensive then they are implicitly conceding that you have a point.
So, although nerds are consciously unaware of their denial, it lurks beneath the surface and effects their emotional response in ways that other people can detect.