Most of the students at the conservatory I went to were women, and essentially all of them had been spending hours a day for 1-3 decades honing their skills. I guess my point is my experiences around women does not mesh with your theory.
Then most of them leave academia because they might at some point in the future want children, which is a 90% chance career-ender.