Lets say you lose 10000 dollars worth of paper clips. Big deal, buy more. But if you lose 10000 dollars worth of photos, computers, files, etc, it is a big deal because they are harder to replace.
Even so, none of those things matter (photos, computer files, etc) when you balance them with a human life.
And then there are all the "houses" built from salvaged materials in poor countries. Not sure if you'd want to count those. A person living in such a structure would still be considered homeless in many places.
It would be more accurate to say 'People are more emotionally attached to people than houses'.
Maybe only to the people involved, but it's likely that a fairly accurate dollar value could still be assigned to the loss.