The other .01% is the only hope we have as a species of honestly addressing our situation and problems and adapting and moving forward. The mob cannot tell the difference between these two groups. In fact, unless you are from the future looking back, nobody can. People who change society for the better through their speech are almost universally hated. At first.
This isn't a nice-to-have feature of modern life. This is critical stuff. To see Ban Ki-moon say “when some people use this freedom of expression to provoke or humiliate some others’ values and beliefs, then this cannot be protected.”? A little bit of us all die.
We as a secular free society must protect people humiliating others, their beliefs and values, through speech. It's the price we paid to get to where we are -- thousands of unpopular folks yelling in the wilderness about how we are stupid, wrong, immoral and how we should improve ourselves. It's much to steep of a price, too much depends on it, for us to abandon it now.