That really is the core of the issue, and furthermore once you've used to a sugar diet you crave it more and regular food starts tasting worse in comparison somehow. I bet it's something to do with the gut-brain connection and a large glut of sugar eating bacteria signalling it's time to feed them. Just a theory, but there is some kind of correlated process there.
And the reverse is also true, if you go a while without eating anything high in sugar, what used to taste normal can taste almost unbearably sweet. Exceedingly hard to do with it added to just about all things in absurd amounts though.