If you set "making someone uncomfortable" as the bar for ousting people or even criminal charges, it's clear that this can only lead to trouble. There's a reason that the law against insults considers only the impression of a third party. The "victim" feeling insulted is not enough.