It's been curious to me from the beginning that this has been treated as a free speech issue. Free speech is a legal question. If a group of people boycott you, they aren't impeding on your right to free speech. In fact, they are merely exercising their own right to free speech.
As a CEO, you have the right to support slavery. As a worker, you have the right to quit in response to those views.