But if you find a job not because you want to keep up with your neighbour but the one which you personally see useful and do it with a sense of purpose then you can easily work extra hours and be happy.
If I had enough money to be "early retired", I would probably still spend most of my days doing something meaningful, but the difference would be that I could take a break any time I would want to, change my focus anytime I would want to, etc. So it would feel completely different from having to follow someone else's rules.
But I guess it's selection bias. If you're the sort of person who likes living frugally and otherwise doing whatever you want, you're less likely to end up making 500k to begin with.
It's kind of like asking why are assholes and psychopaths over-represented in the ultra-rich, it's possible to make it to eight figure net worth on talent, hard work and good luck, but to make it that far and wanting to just keep on going says... something.
I guess it comes down to what you see as negative impacts. I'd never been further than maybe 1500 miles from home until my mid teens, so I don't feel like my kids miss out by not having the kind of globetrotter holidays that people on $500k can do. If I had that kind of money, I'd rather save it and escape the grind ten or twenty years earlier. But I guess if your $500k peers are all going to Dubai and Singapore with their families you might feel differently.
Same with cars, clothes and so on. I'm not talking about barebones ramen living, more trying to take an objective view on the relationship between spend and quality of life, and outside of a few of the most expensive cities, there's a pretty sweet spot well below the 500k mark.