Most of us, if given the chance to have our messages filtered, would choose not to do so. Most people are eager to please and want to know when somebody is unhappy so they can fix it. Only people in the most visible positions are faced with such a deluge of crap that they're forced to do something about it. For the average person, the aberrant attention that comes from a small amount of exposure, such as a conference talk, is just big enough to throw us for a loop but not so big that we'd think about taking steps to never see that stuff. This isn't only a problem for women. Men face it too.
Perhaps the time has come to approach harassment the way we approach spam. Namely, make it easy to report personal attacks so that we can start using the same techniques that block spam to block harassment.