You might want to try it from the other side for a while. It can actually be quite nice to have a job that does nothing other than provide money to pursue your true passions.

For most of my 20's, my life revolved entirely around rock climbing. 4 nights a week in the gym, and a roadtrip every weekend. Vacation time saved up (and exceeded) for trips to Europe, Asia and the Desert Southwest in search of good rock and good times. My friends were all doing the same thing, and those were actually some of the best years of my life.

Now, I'd deeply into building software products to maximize my free time. Not surprisingly, the skills I'm using today are the ones I picked up during those years of paying the bills. The outside pursuits are still a major part of my life (I'm typing this from the climbing mecca of Kalymnos, Greece), but now I have several months a year to pursue them instead of just a few weeks.

So maybe you should take another look at those guys. They just might be leading interesting lives while you're not looking.