Housing also depreciates. It just so happens that for much of history, the lands that those houses are attached to have appreciated fast enough to counteract the loss.