Like, eating, walking out, talking with wife, reading something, playing xbox occasionally - like the things that I wanna keep even if I do the side project.
You would have to take the time from those things.
Also from job too. Many software shops look at the result, rather than the time spent. Might need to shuffle hours in some jurisdictions though.