People always conflate this statement. Only government can take "right" from people. Just opposing people don't make them lose their right. Otherwise it is taking away the right to say against what you say.