Edit: The reasons I wrote as a reply to user projectramo
Of course, replying is also a signal but it's not appropriate in every circumstance. It's redundant when sibling comments provide correct information vs. the downvoted comment's incorrect information and an in-context reading of the thread will make that apparent. Or when the downvoted comment is flamebait/trolling and you don't want feed the trolls. Or when the comment clearly doesn't fit the community norms. And, most importantly, I have neither the time nor the inclination to reply to every comment on HN offering constructive feedback so I pick and choose carefully when I do that... as I'm doing here.
Long story short, HN deemed it acceptable to allow users with a minimum karma level to downvote. It's a feature, not a bug, and as long as it's used with discretion it sends a valuable signal to the comment's author. That feedback mechanism also confers positive benefits to the entire community.