I think what you're missing is the fact raising a child is something that all human beings are biologically engineered to find overwhelmingly fulfilling, yet office environments are not designed with employee fulfillment (or even basic wellbeing) in mind.
Once you become a parent, over time your viewpoint shifts from seeing the baby as an obstacle that gets in the way of other things, to everything else getting in the way of your time with bubs.
I suspect the reason that many of your friends aren't going back to the office is that raising a child is simply more satisfying.