You wouldn't. That's why people use, or include, subjective evaluation.
Usually from the point of view of the problematic person, everyone else is the asshole. At some point the evaluation has to boil down to a judgement call, rather than an objective measurement. This process is always fraught, for instance when the bosses are the assholes themselves or support them (ahem, Travis), but I don't love the idea of just not considering interpersonal factors when evaluating performance. Bad behavior shouldn't have to rise to the level of an HR complaints before consequences are faced, and good behavior should be rewarded.