It's the legacy of colonialism. There is an assumed right for Brits to go anywhere we want. It looks like a majority of the Brits abroad are in Commonwealth countries, which is sort of what I'd expect. Over a million in the US!
If you look closely at UK newspaper comments/letters complaining about immigration, quite a few of them are from people living in Spain. And one of the more notorious anti-immigrant columnists lives in Florida, IIRC.