It increases the supply of blight, perhaps.
Many of those in lower quality housing have jobs. The service workers and whatnot in every community have to live somewhere.
And these days all housing providers, whether for-profit, non-profit, or public, are running into the same issues with zoning, financing, rising costs, etc.