I'm having a lot of trouble understanding the scenario you're imagining here. Are you really just completely fabricating nonsense scenarios as some sort of counterargument? Can we just make up anything we want? "Until the AI hallucinates that Christopher Walken is actually the Egyptian God-Emperor Ramses II and starts grinding human beings into cement to create a giant pyramid in his honor. Is that what you want, huh!?" Does the actual probability of that happening factor into your consideration at all?
Compare that to the probability of human beings air-striking elementary schools, which humans have shown many times they're perfectly willing to do during war.