This is merely one view of free speech; many people actively disagree with this view.
You can't take a contested human-defined concept like freedom of speech and say "this only means X, case closed." I mean, you can, but nobody has to agree with you.
Three people walk into a Hotel. A priest, a advocate for the left, and a advocate for the right. Each three talks about the groups they define as "us", and how bad those "others" are. Can the hotel owner deny hosting and ban one of them based on the identity and vies of the person?
You say these consequences are trivial, but they may not be trivial for every individual. A number of individuals have been banned from multiple platforms, including their revenue streams and parts of the financial system, seriously damaging them financially. Even when I disagree with the individuals being banned, something about this strikes me as wrong. It should not be possible to mount a coordinated attack on an individual's financial stability like this. The boogeyman of the moment is the right, but this will surely be turned against individuals on the left the next time we go to war, or perhaps the next time left-populism seems to be gaining serious ground.