I don't think anyone wants to restrict freedom of movement. It's just about abuse of gullible nature of "us vs. them", creating a virtual enemy which you can easily blame for all your problems. The referendum did not represent will of people, it represented the mood - the negative mood towards their own government and way of life, which does not have anything to do with any migrants. I.e.: IBM creates AI replacing 30K internal employees with efficient process automation? Blame H1Bs! Farmers no longer relevant due to highly automated heavy machinery? Blame Mexicans! When did building borders helped the situation? Even air-tight border separating Northern and Southern Ireland couldn't stop the real IRA terrorists...