On individual scale you’re right, but on the collective level I think both you and GP are right, it’s a feedback loop.
Places become poor for different reasons: shifting economic realities, fall of the previous civilization (eg USSR, which is my experience), etc.
Places remain poor when people feel trapped inside vs consciously deciding to call the place home.