It can be hard if you don't feel engaged with your co-workers but it happens. Set your goals and areas of ownership, develop yourself to support them and start pushing to see if you can progress your career. If they aren't a good baseline to compete with, you have to make your own structure.
If you have a baby on the way pretty soon you'll be in coast mode anyhow (I mean this - if you're still working, some days you'll barely have the energy to focus on your inbox, let alone productive work)
After this stage in your life, re-assess. Maybe your work / life balance is different, maybe you'll be more risk tolerant and change jobs / roles, maybe you'll just be happy. Mostly choice, and hard work.
In regards to the after hours stuff, it's doable as well. It sounds crazy to try and launch a whole side project until you actually do it (even with a baby on board). I noticed you knocked back a suggestion to do an off hours project / startup before, don't rush to close the idea off.
To give context: professionally I put in about 47-60 hours a week depending on what's on, and I brick in every single free hour around that (as stamina and life allows) on side projects. Before I started doing that, I said it couldn't be done, and would park my ass watching TV or generally doing nothing instead.
Figure out what you want, don't measure yourself on others, and go for it. =) If it's what you have now, there's nothing wrong with that.