By far the most internally racist populations I've ever lived in were those where any recognition of ethno-cultural differences was explicitly verboten. If you make a joke about Mexican culture in SF (even if you're Mexican), there's a good chance you're getting fired, so internal thoughts about ethnic differences are suppressed and allowed to fester, and then people cover it up psychologically with a huge dose of self-loathing and, externally, doing the exact opposite of whatever is thought to be racist. The result is a modern version of "white man's burden"; a lot of the people in SF are absolutely convinced that without their help the poor, trod-upon people of color (replacement for "minorities" after that phrase starter to apply to white people in many US regions) would surely starve.
The point being, being a straight white male has nothing to do with it. For the record, I'm neither straight nor white, and I agree with the GP that I felt safer expressing disagreement in conservative environments than I do in very liberal cities like SF and NY.