Isn't soapstone closely related to asbestos? I'd expect it to produce the same type of powder that makes asbestos so dangerous (and on top of silicosis it can give you mesothelioma)
Pretty much any aerosolized mineral is going to wreak havoc on your lungs.