When you get to a certain level of Karma, you will have the ability to vote down comments (but not articles). The figure changes - I think the level is currently 500 (it was less when I rose through the system, but there were fewer members so fewer votes to go around back then).
There's some point threshold, I believe, which you have to reach before you're able to give downvotes.