I mean, you're kind of choosing to care about those things.
In general, these are just different goals in life. If you want a house and kids more than you want the freedom to travel, that's cool and pretty normal. There's no stone tablet handed down from the skies that says that has to be the way it is, though.
When I was 23 I saved a few grand up and went hitchhiking around Europe on a budget of something like < 500 eur a month.
I didn't care about my base income and still don't. I think most people accidentally structure their life so that the 9-5 becomes necessary (e.g. if you rent a room in an expensive city, or a flat or house, now you need to pay for that).
The income is a means to achieve the things that you want. If you can't X because Y, and you want to X, then give up Y, not X, find a different way to do X.
I have a mortgage now, but I didn't bother with it for the longest time for precisely the reason you'd described. It locks you down. I waited until I was sure that it _wouldn't_ lock me down because I could really afford it (i.e. it's not 50% of my income from a full time job).
If I'm being charitable, I had the advantage that I could move my belongings etc in to my parents' house if I wanted to. They're pretty poor, probably in the bottom 20% in the UK, so that's not some fantastic privilege.
If you have fuckup parents (not just poor but failed in some way), then yeah, this becomes a lot harder, and I'm sorry about that.