Yeah spot on. I think the square footage thing, and the various zoning laws and requirements for permits are probably one of the biggest reasons housing is not affordable.
As it is now, if you build more housing, more wealthy people will move in to fill that housing, and more and more, and on and on until you hit a plateau. That plateau will never be affordable for a blue collar worker unfortunately.
My point is that building more houses is not the answer all by itself. Drastic changes to our understanding of property rights and landlording are required as well.