One of work's important dimensions is "are you being paid?" which can be generalized to "I'm doing this because of some external factor" such as in "clothes don't clean themselves."
"do what you love and you'll never work a day in your life" doesn't take into account that external factors have some influence on what you do whenever they are present.