Well in most of US you can pay off the land but you still have property taxes which can go up. Also the tax basis can be adjusted based on the market value of similar properties in your area.