There in-lies the problem. "Hate speech" is just speech you don't like or choose to be offended by. You have no problem with "hate speech" that suits you and your political worldview.
Don't defend the current situation by pretending that it's only hate speech and racism that are getting removed.