"these systems will be operated by individuals"
maybe and maybe not. In some major sense, even today's systems are bigger than any one individual.
Just because something was designed by people doesn't mean they will be operating it years from now.
There was a period where "centaurs" - combinations of grandmasters and computers - would beat computers. Judging by Kasparov's latest book, he still thinks that's the case. But where is the evidence?
Eventually doctors will just press a button and a diagnosis will come out, and dietary program. They will have a very vague idea as to why. This is actually too conservative. There will be no doctor and no button. The system will know exactly when and where to intervene. Humans will live on a zoo being taken care of like animals do now. And this is the rosy picture.
Already, Watson can outperform people and we don't have a great way to explain why. Any more than the proof of the 4color theorem is an explanation why.
Explanations are reductions to simple things. We humans derive meaning from relatively simple things with few moving parts. Something that requires 10000000000 moving parts to explain may as well be "chaotic" or is not really explained. But if predictions can be made far beyond simple explanations then that's a major thing.
I think that humor, court arguments, detective work etc. can all be automated in this manner. And then there is also the access to all the cameras and so forth.
I'm just saying that our systems were designed with the idea that an attacker is inefficient. That assumption is going to break down.
It doesn't have to be the terminator. It just means computers will write better books, jokes etc. a million times a secod and devalue everything we hold dear. They will first be wielded by individuals - at least that's a comfort. But later, the automated and decentralized swarms are the scariest part because they are so totally different from us in goals and everything else too.