do you also use encryption with "regular folks" and verify each others devices?
first it automatically trust the devices but if you want you can improve it with manual verification :
"TLDR: Automatically trust all new devices of contacts that haven’t been verified before, and prompt for manual confirmation each time a verified contact adds a new device."