I downvote really obvious trolls, mean spirited comments and the occasional spam submission. I don't downvote people I disagree with generally. If I see a comment that has been downvoted IMO, undeservedly, I will upvote it.