There is a survivorship bias in ancient structures. Those that wern't up to snuff, collapsed. Most did.
I mean, it's trivially true that anything unmaintained will collapse over a long enough time-frame, but I don't think >50% of buildings built to last collapsed before their time. If anything the damn things were overbuilt and hard to get rid of, even while being plundered for building materials.