The stereotypical danger isn't that they'll make fewer mistakes than a human, it's that the mistakes they do make will be much bigger--continually offloading decisionmaking and decision enforcement to AI without a coherent theory of friendliness is like using Martingale betting: You don't lose often, but it only takes one to wipe you out.