This is more or less an instance of the "paperclip maximizer" problem[1]. Complicated systems optimizing for simple goals often have unintended consequences.

Surely the billions we threw at safe AI must be paying off anytime now right?

[1] https://wiki.lesswrong.com/wiki/Paperclip_maximizer