In this case, bar the rare exception by individuals, these are people who are vocal that they think they're superior based on a superficial biological trait and nothing more.
A lot of things started because people have said bad things, a lot of things also haven't started even though some people said bad things. The problem is something has to start and in order for that to happen, action has to be taken.
Taking action based on the fact that some bad people one time said the same things is a bad idea, you're initiating the actions and inevitably they'll respond with more than just the words they started with.