You clearly have not decided this is important to you, which is your choice. However, because you choose not to pursue it, you are now concluding that you are entirely blameless for your objectively abysmal performance in hiring women. That is not a valid conclusion.
My experience is that once I chose to prioritize hiring women, a bunch of my own hidden biases, assumptions and yes, values, became clear. I realized that I had missed opportunities to hire women in the past. I realized that I had connected values I shared with people I hired as objectively "good" when in fact they just matched mine. I have a high opinion of my skills, so it's perhaps natural that I would do so, but in the end it actively hurt my abilities to recruit a diverse workforce. It was actually quite painful to realize I was the reason for not hiring women in many cases.
The other thing to realize is women, like all humans, have their own biases, and instinctively suss out those organizations that are seriously hiring women, and avoid those that don't. So until you decide that you want to recruit women, and succeed in doing so, you will continue to have a terrible record for hiring women.