I actually did the same and it was life changing. Every day I would get tired and become unproductive at 2 or 3 in the afternoon regardless so I moved my gym time to there. I have more energy, I'm happier, I'm faster at the gym because it's empty. Highly recommended if you can make your schedule work with it.