If you know any women in tech that you think you could ask about this, ask them. If you know any African-Americans or Latinos in tech, ask them. You may learn things that you don't know about right now. And if you don't know any non-white males that you would feel comfortable asking in order to expand your horizons... well, that's evidence of a problem, right?
You find it offensive that there are claims of sexism. I find it offensive that there is actual sexism. I don't know a female tech professional who hasn't been subjected to discomfort, doubt, or harassment. Especially if they're pretty - every pretty woman I know in tech has faced assumptions that she isn't technical, because she's a woman.
No one is going to ruin your career because you made a careless sexist remark (especially if you acknowledge that it was actually sexist afterward). Hell, they can't ruin your career, not in an industry with negative unemployment, not unless you crossed the line into physical assault. Which, by the way, many males techies have gotten away with doing to their female colleagues.
People who disagree with the "narrative" of equality aren't heretics. They're assholes.