As far as I was aware it was the areas that the least amount of immigrants that wanted to vote for leave, but at this point it's moot. And I wouldn't say that fears over immigration are xenophobic, I think that the referendum came at a terrible time when Europe as a whole is facing a big refugee (economic or not) problem that they still can't decide how to solve.