Sounds like a recipe for burnout. I've tried a few times picking up a new language in my free time, but since I program for work it made my days feel 3 hours longer.
I've started picking up hobbies unrelated to programming, it's much easier to spend the time learning something completely different.