It's not that men are "afraid of women", they're worried that they might do something completely innocent that is misinterpreted as harassment, and then they're dragged through the legal system for it.

So yeah, not "afraid of women" at all.