Assuming there is an infinite amount of work to be done, there are still limited resources in the real world that people compete for. Theoretically, we can utilize more land, build more dense housing, and so on to offset the increase in population density so housing remains affordable, but not without changing the physical landscape in a way that many would view as negative (i.e. a concrete jungle).