That would discourage the demoralising situation where someone gets downvoted but is left guessing why.
It encourages replying to bad comments which is already a bigger problem than the sting of an unexpounded-upon downvote. 'No receipts required for downvotes' makes HN better.