There's a karma threshold for downvoting comments, but stories can't ever be downvoted (though they can be flagged, again subject to a karma threshold, so perhaps that's what you meant).