My own attitude is that I can appreciate the humor, but I want top comments to be informative, not comedy. I'll downvote jokes near the top to help bring informative posts up, but I don't downvote when they aren't at the top, or when there are no competing comments.