The fact is that humans are bad at long term impact studies. When long term studies reveal something, it's very hard to take that stuff off market (not that we haven't done so. We have with done that with Talc, Asbestos). It's also possible that something is considered safe today but might be proven to be harmful decades later. We think that organizations like FDA are only thinking about health of people but that's not entirely true, they also need to think about economic impact of their actions. Declaring something carcinogen which is billion $ product, it's going to be very hard for them to do so.
So, my rule is to simply err on the side of caution.