If everyone (or no one) has legitimate power of violent aggression, it's pretty much impossible to run a democracy as the minority would either have legitimate use of force to stop the majority, or the majority would have no legitimate use of force to impose their vote on the minority.

Now I'm in agreement with you.... but the logical conclusion is basically some form of anarchism.

well said.