It's a good way to end up financially secure, but that may not lead to a satisfying career. If you want to be a game developer, are you really going to be happy writing business crud apps with the majority of your working energy? Not necessarily disagreeing, but with kids despite having plenty of passion for those side endeavors, time and energy are quite lacking.
I think you should try and make your passions into your career personally, as long as you are realistic about the opportunities and lifestyle.