So, free movement inside the UK should be restricted? The UK should be divided by countries and block free movement? And what happens if two cities have different cultures? I'm different from my neighbors and I feel I have more in common with people from other countries, how to done that? My country is Christian, but I'm an atheist. I am disruptiny the country culture. I'd that bad?
Global communications and exchange of people and ideas has brought riches to the world that were impossible to think of one century ago.
Tribalism has a romantic appealing, but it's based in the falacy of the Noble Savage.
You are right that there is people that will abuse the system. But, that is true for any system. So, is better to try to improve it instead of throwing it away without an alternative.
People should be concerned about losing their jobs, losing wealth, etc. And look for the causes instead of using a straw man.