Great freedoms come with great responsibilities. I tend to think that free speech works only when the consequences of using that free speech...y'know...exist. In a universe of pseudonymity and anonymity, those consequences don't exist. Even when you are literally
committing the crime of assault (friendly reminder: assault is the threat of violence, battery is the violence) against somebody because they have the temerity to be a woman who makes video games or a black man who criticizes the police on the Internet.
To that end, showing people the door seems eminently reasonable. You aren't going to actually be able to visit upon them the prosecution (again, for literal and extant crimes) that they have earned for themselves, but you can, and IMO should, cut them out of the social universe that you undertake to create and protect.