I have nothing against paying off your loan, but seeing it as your one and only retirement investment is something I have serious problems with. You should live where you are most comfortable living, I don't want people speculating in their homes on a casual basis "knowing" it always pays off. If you're going to really invest in your home, renovate a floor and rent it out. That way, you're contributing to the economy, you're not just speculating you're value investing and you know what the revenue stream of your investment really is. I had the privilege of growing up in a wealthy household with 7 bedrooms and after me and my brother moved out my parents decided three rooms was enough and converted the house into three apartments, living in one and renting out the other two.
Many of the neighboring families however don't like the idea since it means work, but they also don't want to move into something that won't grow as much over time. They're staying put even after the kids have moved out in hopes of cashing in right before retirement.