If you've ever been passionate about something, something that's hard and takes a lot of effort and practice to become good at, would you really let microaggressions stop you from doing that thing? I mean, being a programmer is not exactly a high status thing for white males either. If I tell people I'm a programmer, I generally am competing with the perception that I am socially awkward. People assume I'm like some Big Bang Theory character until I prove otherwise. I don't like that stereotype, but it never stopped me from learning to code, or even was a thought that crossed my mind.
Also, how many other industries are or have been actively hostile towards women and still have plenty of females in it? Show business is an obvious example.
I'm not saying that things can't or shouldn't be improved, but I feel like the argument that goes "well the nerds are making women uncomfortable" is just a cartoon with very little evidence other than anecdotes.