I might be misunderstanding what you are saying, but if there are less than 600k homeless people in America and over 15 million vacant homes, it doesn't seem to be "caused by the physical reality of there being too few homes for the number of people".