It might turn out that way. Or it might turn out that we're better off with AI. There are plausible arguments either way, and so the debate comes down to vibes. Essentially it's "I'm an optimist" vs. "I'm a pessimist."
I decided long ago that - when there are plausible arguments either way - it's better to be an optimist. Optimism does not mean ignorance or denial; rather, optimists should acknowledge risks and problems while having confidence in our ability to generate solutions.
One of the biggest challenges facing us is a critical mass of pessimists. Not only regarding AI, but also with respect to the economy, democracy, liberalism, etc. And while these negative views are plausibly correct, they also act as a self-fulfilling prophecy in that they rob people of the agency that is needed to solve problems.