You can downvote? Does it come with higher karma?
If a submission does not belong on HN you can flag it. Be cautious with flagging because you can (apparently) lose flagging privlidges. (I think I flag too many submissions and I have cut back on that. I think I flag comments carefully).
You can flag individual comments by clicking the [link] link which should then provide an option to flag.
There have been some discussions and guidance about the difference between downvoting and flagging but I can't find them at the moment. (But if you do get downvoted it's nice to remember that some people use it to express disagreement).
My advice is not to flag off-topic posts and just stick to flagging spam or obscene content.