The whole “just leave it and it’s fine” just isn’t practical for a lot of it though. I’m going through it right now, we’re leasing a new lab/workshop which will have some offices etc. in an older building. We literally can’t change any lighting fixture or add any WiFi access points without drilling through asbestos cement ceiling tiles and creating dust. So instead we’re having them removed, because any tiny subsequent change we’d need to do would expose employees to asbestos dust…
It’s just not worth having in any building you want to ever make any alterations to… And the only reason to have it would be just to have the same insulation value with a slightly thinner panel than what we’ll replace it with!