"Having a family," as in, relatives that physically exist, is obviously different from "having a family you value spending time with." I think it was clear the GP was talking about the latter.
Some of us don't have a choice but to work jobs that require that many hours to pay the bills.
I doubt your spending any more than 30 mins per day with your son on weekdays.
My day off is all about family, so it's daily planned :-)
Too late to edit haha.