I have refused to perform 360's in the past.
They are usually semi-anonymous though and no one really noticed. I think that we should be careful of inculcating such a culture. It can support and enforce clique's at work. It also as a deliverable, leans fairly hard on your co-workers. Why should we build a system that essentially delivers pre-digested content for management?
tl;dr: "Overall: a lot of people (for very good reasons!) want to have control over the kind of feedback their manager hears about them." exactly!
It also could become a Vanity Metric, and this doesn't help anyone. [1]