Democracy works best when unhelpful fringes cannot speak. Antisemites for instance contribute nothing of substance to any democracy. Same goes for people insisting on abusing fellow humans based on their sexual orientation or skin colour. How, exactly is democracy hurt by not letting them speak publicly? Their opinions are invalid, not based on any reason (so reasoning with them is pointless), and thus their voice is suppressed, and that's actually a good thing for all those that would otherwise have to suffer harassment and abuse.