This comes far too close, in my opinion, to the view that men just can't help themselves and therefore don't really deserved to be blamed. I think you can take the view that a systemic treatment of the problem is needed without voiding the significance of personal responsibility.
Once you take personal responsibility into account, the potential treatments become more numerous (and less onerous) than permanently isolating men and women (with, one would hope, fair treatment for trans people, but they tend to get left by the wayside in discussions like this). We can ask questions like "how do you create a culture where all men see any form of sexual harassment as obviously unacceptable?" and "How do you make sure men are not incentivized to cover for each other?" and "How can we ensure that reports of harassment or abuse are properly and fairly dealt with, and that the credibly accused are not able to further harass victims?" Unless, of course, you think that evolution has just made male sexual aggression inevitable to the point where we can't rise above that as a species.