The EU didn’t give power to the US. The US took it after the European states got decimated after WWII. Power is not given, it’s taken.
Obviously that depends on the amoount of people and how far something has to fall, but it can happen. Other things will fill the void. Same goes for nations if you look at former superpowers like France, Spain or the UK. Everything can break.