What do you think a "safe space" is? If you are arguing that there should be platforms where people can speak without being shouted down when the audience strongly disagrees with what they're saying, that is a safe space. In order to construct that space, you have to deny some rights of the audience to speak in that context.
And this is the whole problem with naive free speech advocacy. Unrestricted free speech is not possible anymore than unrestricted freedom in general is possible. People cannot possibly hear every single person's viewpoint, so some people will always be denied a platform to speak to some other people.
The question is how best to structure our societal discourse. What values are important, and how do we protect them? And the question needs an answer more complicated and nuanced than "free speech". Because when we don't acknowledge the complexity of this question, we become blind to the de-facto decisions that we're making about which speech to prioritise.