You're not given the ability to downvote without reaching a certain karma threshold, so there are already some thoughts in place there.
No, it says that more people downvoted it than upvoted it by a certain number of votes. Says nothing about the community as a whole which may have never seen the comment due to the downvotes.