We gave up violence and made the state the authority but thats contingent on the social contract being upheld.
Religious institutions had some access to legitimate violence in a way that the state couldn’t control. Once authoritarianism gave way to more democratic governance, that effectively disappeared.