this is extremely wrong. I watched the city I grew up rapidly gentrify, and I have seen my new city(nyc) rapidly gentrify over the past decade. I think your opinion is due to personal underexposure and perhaps some bias toward urban lifestyles.
The pattern is pretty clear, people stick around until kindergarten or middle school. At that point, 50% leave, 25% catholic school, 25% stick around.