> I would guess no small part of them will try to move to the remaining EU states.

Ironically, that might not be as easy as it sounds. Closing the borders works both ways.