Because that was when the factories & their support infrastructure moved, not when a handful of entitled wealthy moved.
Note also that while the factories moved to China, the wealthy stayed right here in the US, & didn't go where their money was spent.
Different scale, different consequences.