This is the problem with working on a startup while you are working a full-time job...you are essentially working all the time.

I can't imagine having a wife+kid to deal with too.

This is why I quit my main job to pursue my startup (with a year of savings). I now have time for my friends and personal life and can work on my own company.

I know it may not be possible in your position, but this is what you eventually need to do.