I do not downvote opinions I don't agree with. I often see a well-crafted comment that is being downvoted, and upvote it although I do not agree with it. I think it's nice to have opposing views, and it's a tragedy when one viewpoint is silenced. Especially on a tech-focused forum.
If I were downvoting people who disagreed with me, I wouldn't always feel compelled to defend myself with a comment. I think those comment threads are almost always quite boring and so I try to avoid them. Being several "generations" deep is often indicative of this.