These people, groups, organizations are not having their ability to speak stifled. They're having their choice of location stifled. There are plenty of people willing to host views that others might find unpleasant. From Gab, to Voat, to nearlyfreespeech.net, self-hosting and the like.
Now if your argument is (as often, theirs is) that those platforms are fringe, not nearly-as-popular, I would theorize that that is because a larger majority of people have heard some of these things and have zero interest in hearing more.
But they can still say it.
And at that point, I ask, what is the cultural value of requiring people to hear things they've decided they do not wish to?