Other technical fields have a higher male/female ratio, so neurological gender differences doesn't seem like a promising hypothesis.
When I was in grad school, the math major had lots of women. The vast majority were education minors. The undergrads taking grad courses (note: every serious math major does this) were mostly men.