"doesn't matter in what manner was it spoken"

It's frustrating when people say this over and over. It certainly matters when the way it was spoken was antagonistic and rude. And I don't believe as this person states is an issue of cultural relativism, just a jerk wanting to be a jerk.