No amount of money is worth giving up these irreplaceable years with your children. You cannot get these moments back. You can't "make it up to them later" when you are filthy rich. If you miss teaching your kid how to ride a bike, it's gone forever. No amount of money can fill that hole.
I'm speaking from experience. I did it. I worked the 80-90 hours a week getting my startup off the ground. Raised millions in VC. And I regret it terribly.