I think that you can be passionate about what you DO without loving your job. I've had jobs I hate, but I've never stopped loving building things.

As an aside, I do love my current job. When you can get both hang on to it!