You're allowed to physically go anywhere and visit as a tourist. It's just that if you want to to permanently move to another city, you have to do a bunch of bureaucratic paperwork. In reality, people move around all the time, but it's rate-limited, and it's easier to go from a dense place to a less dense place.
As a point of comparison, consider the housing crisis in San Francisco. One could facetiously argue that political forces limiting the housing supply creates a similar effect.