You neglect the other 8 hours in a day, and you aren't alone in that. I have a ton of coworkers who do their 8, go home and watch tv and have a beer, then go to bed.
Meanwhile I'm going on short hikes, taking classes or hitting the gym, or going to shows and meeting new people.
With kids, the equation is obviously different (at least the eight hours of sleep portion) but you can take the little one to the park, to play dates with other kids, and occasionally non-kid focused events (the last beer fest I went to seemed to have several kids running about).
At the end of the day you have to prioritize how to spend your time and use it fully. It is harder then just watching tv and having a beer, but much more rewarding. Take classes, volunteer, be social. Your time is limited, always use it well.