So after all this self improvement, it's so that you can meet women who don't have the same driving forces, and actually have quite the opposite -- they can just choose not to date you because you have a funny haircut or they aren't sure and don't feel like following up. That mismatch of effort is a great way to drive resentment on both sides.
I'm not trying to place blame here. All I'm saying is: if you're a single straight male in the bay area, it's probably just the gender ratio of your social circle and social habits. Don't turn blame inwards towards perceived personality defects. In a different city or different friend group you might get drastically different results