Asbestos and lead are also minimal risk undamaged in-situ. Both are now banned, and for good reason.
Asbestos can get into your air through accidental damage to insulation, or in the case of lead, paint chipping or pipes aging can do the trick. This is just something that happens incidentally through the regular lifetime of the material, not because someone decided to do something to it.
Opening up a dry wall on the other hand, will inevitably dust up the whole house.
You can still find it all over the place in things like cabinet pulls, door handles, and even ceramic tile.
Gas welding the material results in lead fumes. There is a big quarrel about the usage of lead in water pipe connector brass parts going on in the EU.