>Sure it's not from the state but does that make a difference if you have to live in fear?
It makes a massive difference!
If some random person tries to kill you and you blow their brains out in self defense the court will almost certainly back you up (assuming it's legitimate self defense). If random person someone tries to kill you and the police happen to be nearby they will probably intervene.
In contrast, if the state comes after you you're screwed. If you defend yourself you're even more screwed. You can't even call the cops.