Toxicity and fraudulent misadvertisement is a far cry from sugar being bad for you if you choose to eat too much of it.
And to reiterate my point, advocating X based on "don't we already Y" instead of the actual merits of X is a big part of how dangerous slippery slopes occur, even if Y was a good thing.