I’m sure you have reasons for believing this, but I cannot fathom it.
Put another way, look at what empty lots sell for, and compare that to what a similar lot with a (not dilapidated) house sells for, in areas where the land values would be similar.
The only exceptions I could imagine perhaps being the places with crazy property values. But, the US is large (so, not just San Francisco)