I can see where you're coming from because you've already determined that you don't have anything to lose by standing up for yourself. However, the folks that distance themselves from you undoubtedly have things to lose, and can't afford to share your fight. You could certainly label those folks as cowards, but I think it's a bit disingenuous.

As you are finding out, the government can take a lot from you when you piss them off. In the case of people who otherwise share your sentiment, it's simple risk management to protect your loved ones from similar treatment, particularly if you're raising a family. Not many employers will stick with you if you get this kind of harassment in your personal life, because it will eventually affect them too; that cuts right into feeding your family, which is high on my list of things I will not sacrifice. Putting my family above an ideal is not cowardice, particularly when my family isn't even aware of the reason for an ideal and definitely doesn't share it.

It's also dangerous to assume that a given outcome is unlikely for any set of circumstances. Continuously, we read about things that blow our mind when governments abuse power, and there are probably far more things that we are not lucky enough to read about; if they really wanted you gone, you'd be gone tomorrow and none of us would ever know. It stands to reason that you haven't disappeared yet because they want Assange. Planning for the best from your adversary is a dangerous path, I think, but I know that you're far more familiar with your own circumstances than Mr. Internet Commenter here is.