In the end, no factory builds itself. It takes actual persons out there pouring concrete. Real, fellow humans choosing to ignore the well-being of all the people living around them, enter their neighbourhood and in effect destroy their homes.
The fact that society is so bureaucratised we don't think of it that way freaks me out a little.
The solution is not more bureaucracy. The bureaucracy is how we ended up in this situation in the first place, where I could walk into a neighbourhood and ruin it, as long as I have the right official permits, and then sleep well at night thinking that I have done a good job.
How about we try to collectively drop this idea that "I'm an X therefore I pour concrete where they tell me to without thinking more about it?" Make people personally responsible for their actions!