Getting in and starting early, finishing up early/mid afternoon and then enjoying the evenings either working on my own thing or just spending time with the SO has significantly increased quality of life.
It's very hard for me to put a problem down and simply not think about it for a period of time, but as I've matured I've realized how important that skill is.
It's a constant struggle to leave things behind and properly unwind at the end of the day.
For me, the appeal of non-standard hours is that it's dramatically easier to focus when my coworkers aren't around (and to some extent, this is true even when remote). Truth be told, the optimum for me would probably be to just write mornings off completely and have them as the "family time" slot.