A good way of looking at rights is: yours end when it begins harming someone else. For example, one can “assemble”[^a] and protest, but once you start getting violent, your right to protest is gone and you’ll probably be arrested.
Tangent:
However, there is a controversial reading of the concept of free speech (concept, not First Amendment), and that is: what about monopolies silencing you? Most people would agree that removing a disorderly person from your restaurant is ok, but where do you draw the line when it comes to monopolies?
As in, what if a restaurant chain owned 90% of the restaurants (all brands included) in the country, and they banned you because they didn’t like the words coming out of your mouth?
I don’t know the answer to that.
----
[^a]: quotes because the First Amendment refers to it as “assembling”