If you do that, the positive would still come out way way ahead. (And not it's not priced in already contrary to popular belief)
The reality is that we can't sustain a civilisation of 8billion people without fossil fuels. We should do what we can to find alternatives that are less pollutant and have higher energy density but for now that means fusion, thorium and traditional fission. But we still have to solve the materials issue and we still have to content with the fact that only 20% of our energy is based on electricity and any attempt at increasing that number will require lots of fossil fuel usage as you would have to replace all the machines out there.
We are going to be dependent on FF for a long long time.