Actually you cannot downvote submissions on HN. You can only downvote comments.