There is no scientific basis for this assumption (the idea that you rake in immunity "debt" by not getting sick, leading to worse symptoms /when/ you get sick).
I don't have citations handy, it's just something I've seen mentioned here and there some months ago, as a possible explanation why after 2 years of lockdowns, many more people seem to catch the common seasonal diseases.
https://www.theatlantic.com/health/archive/2020/08/covid-19-...