Right, but thankfully most people aren't interested in raw land area and more interested in livable space. If you bulldozed a few dozen houses and built an apartment building on top, you still increased the amount of people that could be housed there.

I'm on the 21st floor. This floorspace didn't come with the land.