Climate refugees are going to be the big issue, not where to choose to move if you have that freedom. Any question of where to go has to somehow answer "What happens when everyone else who can tries to go there?"
Not to mention the moral issues surrounding letting tens of millions suffer and die because we don't want to help people.
Can you really keep out tens of millions of people with a wall?