I didn't downvote, but dang and sctb have said several times that it's absolutely fine to downvote because you disagree with the opinion expressed, and in fact Reddit has guidelines against doing just that. The HN guidelines also note that it's boring to read people complain about downvotes.
dang once told me that a post's score tends to fluctuate up and down. The key, I've learned, is to not bother what people who have no counter-arument think about your opinion. A downvote is the equivalent of someone saying "nyeh" or flipping over the chessboard. Just move on.