A lot of people bought into places that weren’t very desirable and helped make the place desirable. There’s a lot of old towns that were down market from where they are today because the housing stock aged and owners couldn’t afford the renovate. But eventually some people took a risk and did because they saw the potential. Then more did and so on and the town is much more attractive than it was.
The idea that an interloper should just be able to walk in and exploit that is ridiculous. Talk about getting in while the getting is good!
There’s plenty of shabby places with potential. Go there and unlock it. It’s futile to try and jump on the back of people that did that elsewhere by demanding they build affordable housing after they turned a place around.