I see your point. I think one needs to consider both the danger of the waste and the amount of it generated. Then try to find a good balance.
If something is infinite, meh, it's infinite, what you gonna do. But if it's a few million years ... whoa, we can reason about that!
To be honest I'm just asking the question that while we can all say "isn't it great how safe nuclear is" we still haven't 100% figured out the waste issue. Fusion... well I'll believe it when it's powering my DeLorean.
http://www.bbc.co.uk/news/business-31725365
Behind schedule and over budget is totally normal of UK big projects. But still, £58bn is a lot of money to fix something that's not a big problem.
I imagine there have been a lot of places in your country (as with any industrialized country) that have been horribly contaminated with non-nuclear pollution, then cleaned up. While these events can certainly be used as an argument for taking more care, they're almost never used as an argument to give up on the whole idea of industry.
Nuclear waste is bad, but it doesn't seem to be on the level of "we must lock this up so securely that God Himself cannot access it" as people seem to try for.