Arguably, housing is the biggest and most important expense in one's life, and that has become a lot less affordable.