I think you do have a right to hold a controversial opinion in public and not have your belongings destroyed because of it.

"That person said something I disagree with" doesn't imply that you have the right to demolish their property and their job.