Sure, you don't personally need guns, but you do need physical safety at each end of the communication. Physical safety is provided by people with guns.
Police violence is more of a way to discourage wrongdoing on the part of rational actors. Irrational actors (terrorists, mentally ill, drug-addled, enraged, desperate) probably won't be affected short of an oppressive police state.
If you buy that argument you could also argue that govermnets should be trusted as a holder of cryptogrphic keys.