We unfortunately do not have enough women or people of color in positions of authority for me to provide some rigorous statistics documenting the experiences of a swath of such people (though this gives a good indicator we've got a problem).

However, it seems quite clear to me that minorities in positions of authority or public visibility face a level of vitriol unlike that experienced by some boring old white guy. Look at the level of hatred directed towards Hilary Clinton or Barack Obama; look at the hatred directed towards a woman trying to present at a tech conference; look at the death threats Anita Sarkeesian has received for making YouTube videos on video games.