That's probably part of the problem. Anybody can just sit around flagging content with a low karma threshold and much fewer people are allowed to vouch back. It's the exact opposite of the downvote threshold on here which is designed to keep people from just killing off opinions they disagree with.