Personally I don't give a shit if people can sit on their house forever at -5% real interest rates or whatever. Just let me build a shack out of chicken wire, 2x4s, and tin roof. If you get to rig the game to get a house the least you can do is let me build something with whatever scraps are left in the financial system.
Letting you do that will bring down the price of houses.
The people that fight hardest against this are the ones that crow loudest about fair and affordable housing, ironically enough.