It seems to me that people who started driving as teenagers have a fundamentally different relationship to the activity. They presumably went through a phase where the license was a manifest symbol of adult freedom and they had fun experimenting with the car. With that fundamental mindset, you can probably enjoy just driving around.
Whereas myself, I don’t find any pleasure in driving. It’s just a necessary chore to get somewhere out of reach by train. It requires a constant level of attention that I’m not used to, and I’m always too conscious of the potential of catastrophic consequences beyond my own control if anyone in traffic makes a mistake or happens to be feeling suicidal. There’s no joy at this age in wrangling these big machines.