I've definitely interviewed female candidates for a small startup where they decided not to proceed once they found out they'd be the first woman on the team. I certainly don't hold it against them, but it really does make increasing diversity a lot harder if nobody is willing to be the first one.
It's a great example of how hard it can be to change the trajectory of systems even when everyone earnestly works towards change.
I don't know how well it would work, but it's an idea...
I'd rather have a happy and productive career than an ugly sexual harassment and wrongful termination suit.
"Oh, you don't have any other women on staff? You need to know that thats going to be sort of rough for me, in complicated gross ways. I'll still do it, but only if you pay me an extra 10% compensation pay on top of what you were otherwise going to pay me. (Which you can stop doing as soon as you hire another woman)."