The right to ignore someone else is not the right to have police arrest and remove them without charges because you don't like the opinion they're expressing. That's fascism.
Unless you want to call right-leaning and left-leaning dictatorships both "fascist".