Real estate inflation has been dramatic over the last several decades. If there were really a glut of old people attempting to offload their paid-off homes on the market, the prices might drop to more historically normal levels...
I’m not sure how the statistics actually work out but if single or married people are staying in oversized homes for longer without kids, it does seem like that could affect the supply of homes for families with children. I know the UK had a controversy over a “bedroom tax” that tried to address this issue.