It would be nice if downvoters had to add a compulsory comment, though I suspect many users would create a special login they use just for downvoting. HN is a lot better than other sites though, such as Reddit, where some subreddit moderators often delete comments after you've replied to them, leaving your own reply as an invisible orphan.