A lot of people are incapable of thinking in gradients and can only think in black and white. I think these same people end up quite surprised when humans do unexpected things outside of their b/w thinking.

There are so many different possibilities of things going wrong here it's very hard to keep track of all of them. We already see a lot of "minor" problems occurring, and things that we may consider moderate like wide scale AI accelerated crime are happening now.