I'd choose my wife if I really had to. Fortunately I've been able to make it work pretty well. I spend almost all my non-startup time with her, which is why it works I think.
I like what you said, and it mirrors my experience. It comes down to what your priorities are. In my case it's family, work, then other stuff. It's a lie to believe that you can have/do it all, but it's generally true that you can have/do the things that are really important to you. I don't ride motorcycles, fly RC airplanes, or play guitar much anymore, but I'm okay with that because they were lesser priorities than the top two.