All our systems are predicated on the inefficiency of an attacker.
Voting. Sybil resistance. Social reputation. Online reputation. And so on.
Deepfakes and ubiquitous cameras mean that in about a decade or two computers will be able to generate believable video of anything. We already have AI that can recognize behavior from video and Palantir-type processing can predict how and when people will try to coordinate. Parallel construction can be used in courtroom cases to put people away.
In short — it’s not that difficult to imagine that, in the next 2 decades, all our systems begin being attacked.
And this is ignoring the fact that drones and self-driving cars will be ubiquitous and easily taken over by sleeper programs which then wake up and coordinate swarms.
Again — no need for some self-replicating GENERALLY intelligent AI. Simply a bunch of people who wield botnets that can bootstrap themselves faster than our current systems can shut them down. They will just have sleeper accounts until it’s time to deploy.