I wonder if part of it is that hackers look down on female-dominated lines of work. We imagine that being like us is the best thing in the world. It is a decent line of work, mind you, but it has its downsides and not everybody is cut out for it.
I think it's more of a class thing than a sex thing.