Who says you are supposed to enjoy the journey? As a trivial example, 'the journey' of studying for an important exam is hard work, and you would enjoy playing video games instead a lot more. But by focusing on the destination and enduring hardship, you ace your exam, which has a massive effect on the rest of your life. Was the destination not worth it?