Now you have a group (or multiple groups) of people that will use violence to prevent people from doing the things that they feel are wrong. Probably they'll decide on what those things that are worth using violence to prevent are, and probably they'll write them down so that everyone is on the same page. If they don't do that, then they are using violence for arbitrary and undefined reasons, which most people don't want. I think I see where this is going...
What is the vision for this scenario that doesn't just turn into new groups taking power and enforcing their rules?