You can, you just need 501 karma first. Seems like someone wanted to prove you wrong since you've been downvoted.

You need 500 karma for the downvote button to appear: https://jacquesmattheij.com/the-unofficial-hn-faq/#karma