This is assuming stable economic and population growth. There are lots of rural and inner-city property owners who could provide a cautionary tale to this theory.
Even after the current crash they're still significantly overvalued compared to their historic prices, once you take into account inflation.