Housing can't be inflated and unaffordable at the same time. Someone is buying properties, driving prices higher. Those someone can definitely afford housing.
By "unaffordable" people mean that median person/poor person has problem with paying for housing. Not that no one at all can afford it.