The question of who "deserves" to live in a city, and who gets to decide that, is as old as cities themselves, and nobody's found a good answer yet.
Remember that every current resident who isn't evicted means one person who wants to move in to the city isn't able to.