There are an order of magnitude more votes than comments on HN. Asking people to supply a comment with every vote would quickly degrade the signal, overwhelming it with noisy "I agree" or "you're wrong"s.
People occasionally explain downvotes. They are not obligated to.