This was my experience too. In that time I would have had to reinstall most LTS distros a couple of times or regular distros many times.

I have heard that in-place upgrades are getting better but back in my Ubuntu days I never had luck. It seems like you are always going to slowly accumulate cruft that the installer doesn't fix.