In my understanding you don't start with a "full health" and lose it over time, instead you can always get better or worse from the position you are in.
So while you won't have some dramatic problems, you'll be missing out on how good you could feel all this time.