My parents house (in the EU) was covered in plates of asbestos. As far as I know it only is dangerous when you install / remove it as these plates break and release chemicals to the air. I’m no expert though.
Which is why a single exposure will damage your lungs, but it takes lots of cycles of damage and repair to chance into getting cancer.