You'd need stereo fotos from a low flying plane for this. Several cities are doing this for decades already. I've built such a 3D map for my city like 25 years ago.
Some noise, but since houses have a certain size and being mostly rectangular helps. Just carports and garden houses are special.