It's so easy in Norway. When you start a new relationship with another bank, they just offer to move all your money and automatic bill payments from the other bank to your new bank. So the new bank handles everything
I'm glad for that too; mail is pretty much dead, I wouldn't know what organizations to report an address change to nowadays.