This is a sad state as it can give power into the hands of mobs who can bring down any post if they wish but I guess I would have to live with it
From what I've seen though, "bad" uses of flagging don't happen that often. Usually it's for blatant spam or troll posts. But I guess there will always be exceptions...
The worst a mob can do is alert people that there's a decent number of users who don't think a post should be on the site, which is true.