Sometimes you can get caught up in a 'grass is always greener' syndrome. That is, imagining that your life would have been so much better had you done X instead of Y.
Chances are, in an alternate reality, you'd just be stressing about a different set of things.