Thinking about this more, at least in my city it seems like one of the problems is that for a generation now, politicians have consistently outsourced decisionmaking to a poll of the community.
In theory, one elects a politician to be independent decisionmaker for the constituent's interests, for the length of their term; and if at the end of the term the people didn't like their decisions, they're voted out. This gave politicians latitude to do what they thought was best, with the greater good of the community in mind.
In the past half century, (and again, only in my city) this model seems to have changed to politicians being elected, and then running every decision past the community as a kind of popularity poll. Developer wants to replace an auto lot that's been abandoned for a decade with dense apartments? Better poll the community to see what they think. Adding a protected bike lane to connect two existing bike networks? Let's ask the community first. And of course when they do that, the only people who show up are the NIMBYs, and the politicians get the impression that nobody wants development.
The NIMBYs have spoken, we better leave that disused auto lot abandoned and blighted! (And this is a real example from today's news!)