I mean... Us humans have done that countless times in history. Cannons, Tanks, Nukes, Space... One thing history proves is that if one side can develop a next gen weapon that you can't defend against, your civilization ceases to exist.
Every single one of those advancements caused more problems than they solved. We don't need AGI for "AI" to be more dangerous. Just some kind of super trojan would do.