Went through a similar thing in Germany. These are annoying details of an international move. I think the real solution that minimizes heartache is that you have to get local versions of all accounts - both banking and digital - including re-purchasing apps. One high-tech thing you can do is get a dual-sim smartphone (which excludes iPhone, naturally) so you can have both numbers on the same device. Although, honestly, I'd recommend just getting another device.
As for credit cards, definitely get a local one because most CC's will kill you on exchange rates and fees. Get a local bank account, a local credit card, and transfer funds with something like TransferWise [1]
Amazon works okay internationally, although again I'd recommend using two URLs (or containers) for each version. For example, you can access Canadian Amazon with "smile.amazon.com", and the Israeli one with just "amazon.com". But in general I think it's a good idea to use a container- (or browser-) per-country.
I'm not sure I entirely blame the digicorps on this one. Compliance with local law is difficult enough in isolation; these "dual digital citizen" cases are probably really complex. In fact, I'm surprised Spotify works seemlessly; it's probably an oversight by the music publishers.
This is all a corrallary, BTW, to the general truth that the only way to make money with digital goods is by creating artificial scarcity.
1 - https://wise.com/invite/u/joshuar301 - full disclosure, happy customer and this will generate 60 euros (under some circumstances) for me if you sign up.