I don't believe many (any?) people think they're doing Evil with the goal of harming others as the ends. It seems most likely that people think they're doing something for a greater good, but that requires sacrifices (e.g. "Yes, we have to murder/imprison all the Jews/Asians/Gays/Whatever, but that's because they're ruining our country").
And I don't know how many people are trying to be be Mean but not doing a small Evil. What does a Mean act that doesn't harm the other person look like?
Also as someone who regularly engages in identity politics, I think your last point is just a "No True Scotsman" but also sort of proves my earlier point: being kind is doing good without regard for the optics, and everyone thinks that's what they are in their head.