There are some nasty game theory outcomes to keep in mind here. (See also : cold war nuclear arms race.)

https://www.lesswrong.com/posts/hc4DbmhdzZpSLMQ9Y/the-ai-rac...