So what? Standing up for what you believe in is never easy, and almost always involves challenges like those. Imagine if Dr. King gave up because he was anxious and depressed with death threats coming in on a regular basis.
Failing to take a moral/ethical stand because you're worried you might lose money or have to withstand some social anxiety blatantly shows that you don't really believe in those morals/ethics.