Why would it do anything? Unlike living things that have gone through the rigorous gate of survival-of-the-fittest over millions of years, AI only does what it was trained to do in the sheltered environment in which it has been coddled; teetering atop an impossibly complex supply chain whose only defense against entropy is humanity's greed.

This (implied) end state isn't inconsistent with my scenario. We already see the incredibly hubristic "I'm the only person who can safely handle AI!" attitude among the people working at/running the big labs.