The problem is that the definition of "hate speech" and "racism" have drifted wildly according to some (mainly on the left). I have seen people on the left accuse 100% of Trump voters of being racist. I have seen people accused of racism for opposing co-governance reforms in New Zealand. I have seen people accused of racism for criticising Will Smith when he physically assaulted a comedian.
So yeah, I oppose censorship of "racism" and "hate speech" because I don't trust the powers that be to maintain reasonable definitions of these terms.