Maybe more the opposite: in the long enough term radioactive materials are just ugly rocks. It's more the short term storage in the here and now that is the concern for most people, because they are understandably afraid of DNA damage and cancer.