I also make a habit of upvoting comments that have been unfairly downvoted, and downvoting silly one-liners that don't add anything but noise to the discussion.
As for my own comments being downvoted, it really makes no difference to me since people can still read the comment. If I ever get hellbanned, I'll just leave.