I’m afraid absolute freedom is slightly overrated. You have to draw the line somewhere. I’m okay with where it’s been drawn today. It’s a “you’ll know it when you see it” thing.
This isn’t authoritarianism, and we can still rightfully claim to be a tolerant society with sound rejection and banishment of hate speech. Hypothetical example, my religion does not believe in gay marriage, yet I don’t prohibit others from pursuing a happier life. But (the royal) you must absolutely draw the line at enabling hate.