”But they are so smart…” argument is bs. Nobody can be presumed to be super good outside their own specific niche. Linus Pauling and vitamin C.
Until we have at least a hint of a mechanistic model if AI driven extinction event, nobody can be an expert on it, and all talk in that vein is self important delusional hogwash.
Nobody is pro-apocalypse! We are drowning in things an AI could really help with.
With the amount of energy needed for any sort of meaningfull AI results, you can always pull the plug if stuff gets too weird.