Practically speaking, people will spend their money on limited resources like land and basically lose out on most of the gains. That's the primary way "housing as an investment" earns money, by extorting the wages of future workers. If there are more workers (women and men) then you get to earn even more despite doing absolutely nothing to deserve the money.