The idea of ai as a novel self replicator is cool and appears in movies and books, but doesn’t seem to exist outside of fiction. The other article referenced seems to dream of a future 2030 AI with all the capabilities one can imagine isn’t supported by any reasonable projections for AI technology. It might as well be a warning about all the dangerously weaponizable portable fusion reactors that could exist if ITER development is super successful. In this respect, AI seems like an unlikely driver of catastrophe as defined in the near term.
Putting even a 5-10% increase in rates of calamity due to this technology, which has no evidence to support it, while discounting all other technologies including nuclear weapons claiming there’s too little data is not reasonable. The reality is, we don’t know what risk value to assign. We won’t know for some time.
Just leave out the AI bit from the otherwise reasonable looking statistical analysis, and you’ll be left with a more intellectually rigorous and useful work.