That said, the time from 0000-0330 is amazing. For the same reasons people like to wake up really early (3+ hours before going to work), this time is (human, coworker and outdoor capitalist) distraction free, I can't run boring errands outside, so I can focus on creative work at home. It's great that it can double up as late-night partying/dating/gaming/social time. But other than maybe once-a-week for gaming, I use it for the others once a month or rarer.
There are some social costs however, besides the professional one mentioned earlier. I'm a complete corpse when trying to make morning weekend plans (breakfast/brunch, hikes, events). I get to be known as "that guy who only gets up at noon". Which makes me wonder, is waking up at 0400 so much more socially upstanding that going to bed at 0400 if I'm using my isolationist time mostly the same way? Waking up early is associated with discipline and diligence, staying up late is associated with childishness and immaturity and lack of discipline.
I't all just a trade-off. I suppose one can train for schedule flexibility, but I love my late nights.