That's actually a really good point for housing as public infrastructure. The parallels to roads are very interesting.
You must destroy demand. It is the only way out.
Building as much (and sustainably) as possible + a land tax to discourage speculation and people not actually living in housing might be a better solution.